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1  Introduction  and  Organization 

Every  physical  actuator  is  subject  to  saturation.  For  this  reason,  the  original  formulations 
of  many  fundamental  control  problems,  including  controllability  and  time  optimal  control,  all 
reflect  the  constraints  imposed  by  actuator  saturation.  Control  problems  that  involve  hard 
nonlinearities  such  as  actuator  saturation,  however,  turned  out  to  be  difficult  to  deal  with.  As 
a  result,  even  though  there  have  been  continual  efforts  in  addressing  actuator  saturation  for  a 
chronological  bibliography  on  this  subject),  its  effect  has  been  ignored  in  most  of  the  modern 
control  literature. 

On  the  other  hand,  it  has  been  well  known  that,  when  the  actuator  saturates,  the  perfor¬ 
mance  of  the  closed-loop  system  designed  without  considering  actuator  saturation  may  seriously 
deteriorate.  In  the  extreme  case,  even  the  stability  may  be  lost.  Actuator  saturation  is  a  partic¬ 
ularly  important  consideration  in  reconfigurable  control  systems.  Following  a  system  failure,  it 
is  likely  that  the  available  control  authority  will  be  reduced,  and  that  the  reconfigurable  control 
system  will  drive  actuators  into  their  saturated  regime  to  stabilize  the  systems  and  to  attempt 
to  regain  nominal  performance.  A  well-known  example  of  performance  degradation  (e.g.,  large 
overshoot  and  large  settling  time)  occurs  when  a  linear  compensator  with  integrators,  say  a  PID 
compensator,  is  used  in  a  closed-loop  system.  During  the  time  when  the  actuator  saturates,  the 
error  is  continuously  integrated  even  though  the  control  is  not  what  it  should  be,  and  hence,  the 
states  of  the  compensator  attain  values  that  lead  to  larger  controls  than  the  actuator  limit.  This 
phenomenon  is  called  integrator  windup.  In  the  absence  of  integrators,  a  given  reference  setpoint 
might  result  in  a  different  steady  state  response,  causing  the  need  to  reset  the  reference  to  a 
value  different  from  the  desired  setpoint.  With  integral  control,  the  controllers  automatically 
bring  the  output  to  the  given  reference  setpoint  and  hence  the  integrator  does  the  reset.  For 
this  reason,  integrator  windup  is  sometimes  referred  to  as  reset  windup. 

A  practical  approach  to  compensating  this  performance  degradation  due  to  actuator  satura¬ 
tion  is  to  add  some  problem-specific  anti-windup  schemes  to  deal  with  the  adverse  effects  caused 


by  saturation.  These  schemes  axe  typically  introduced  using  ad  hoc  modifications  and  extensive 
simulations.  The  basic  idea  behind  these  schemes  is  to  introduce  additional  feedbacks  in  such  a 
way  that  the  actuator  stays  properly  within  its  limit.  For  example,  several  schemes  have  been 
proposed  to  solve  the  reset  windup  problem  when  integrators  are  present  in  the  forward  loop. 
Most  of  these  schemes  lead  to  improved  performance  but  poorly  understood  stability  properties. 
More  recently,  some  researchers  have  attempted  to  provide  more  systematic  and  more  general 
schemes  to  deal  with  the  problem. 

In  this  project,  we  have  taken  the  approach  of  considering  actuator  saturation  at  the  outset 
of  control  design.  As  seen  in  the  recent  literature,  there  has  been  a  resurge  of  interest  in  this 
approach,  possibly  owing  to  its  systematic  nature.  A  fundamental  issue  is  the  identification 
of  the  class  of  linear  systems  that  are  (globally)  asymptotically  null  controllable  by  bounded 
controls.  A  system  is  said  to  be  globally  asymptotically  null  controllable  by  bounded  controls 
if,  for  a  given  bound  on  the  controls,  every  state  in  its  state  space  can  be  driven  to  the  origin 
either  in  a  finite  time  or  asymptotically  by  a  bounded  control.  In  particular,  it  was  established 
earlier  that  a  linear  stabilizable  system  having  all  its  poles  in  the  closed  left-half  plane  is  globally 
asymptotically  null  controllable.  For  this  reason,  a  linear  stabilizable  system  with  all  its  poles  in 
the  closed  left-half  plane  is  commonly  said  to  be  asymptotically  null  controllable  with  bounded 
controls,  or  ANCBC,  and  most  of  the  recent  work  has  been  focused  on  ANCBC  systems.  For 
such  systems,  various  types  of  feedback  laws  have  been  proposed  that  work  globally  (on  the 
entire  state  space)  or  semi-globally  (on  any  a  priori  given  arbitrarily  large  bounded  set  in  the 
state  space). 

It  is  clear  that  a  linear  system  having  poles  in  the  open  right-half  plane  is  not  globally 
asymptotically  null  controllable  with  bounded  controls.  Any  feedback  laws  designed  for  such  a 
system  would  not  work  globally.  Two  natural  questions  to  ask  are: 

•  for  a  general,  not  necessarily  ANCBC,  linear  system  with  saturating  actuators,  what  is 
the  asymptotically  null  controllable  region,  the  set  of  all  states  that  can  be  driven  to  the 
origin  in  a  finite  time  or  asymptotically  by  a  bounded  control? 

•  how  to  design  feedback  laws  that  work  on  the  entire  asymptotically  null  controllable  region 
or  a  large  portion  of  it? 

This  project  answered  these  two  questions,  for  both  continuous-time  and  discrete-time  sys¬ 
tems.  We  started  with  explicit  analytical  descriptions  of  the  asymptotically  null  controllable 
region.  Once  we  have  identified  this  region,  we  designed  design  feedback  laws  that  achieve  vari¬ 
ous  closed-loop  performance  specifications  on  the  entire  asymptotically  null  controllable  region 
or  a  large  portion  of  it.  These  performances  range  from  the  basic  control  problem  of  stabilization 
to  those  beyond  large  domain  of  attraction  such  as  transient  properties,  disturbance  rejection 
and  output  regulation.  The  key  to  achieving  stability  and  performance  on  the  entire  asymptoti¬ 
cally  null  controllable  region  or  on  a  large  portion  of  it  is  to  push  actuators  to  work  to  their  full 
capacity. 

This  final  technical  report  is  organized  as  follows.  Section  2  summarizes  the  results  obtained 
under  this  project.  For  clarity,  we  will  itemize  each  result  as  appeared  in  the  book  or  journal 
publications.  Copies  of  these  publications  are  included  in  the  Appendix.  Section  3  includes  a 
few  topics  for  future  research. 

We  greatly  appreciate  the  support  of  the  ONR,  in  particular,  that  of  Dr.  Allen  Moshfegh 
and  the  Young  Investigator  Program. 


2 


2  Main  Results:  Book  and  Journal  Publications 

The  results  obtained  under  this  project  have  been  reported  in  one  book,  one  book  chapter,  20 
journal  papers  and  many  conference  papers.  Another  7  papers  are  currently  under  review  for 
journal  publication.  In  what  follows,  we  will  first  list  the  book,  which  contains  a  systematic 
description  of  the  majority  of  our  results.  The  journal  papers  and  the  book  chapter  are  then 
listed  in  the  chronological  order.  The  results  originally  reported  in  conference  papers  have  either 
been  published  in  journals  or  are  currently  under  review  for  journal  publication.  For  this  reason, 
conference  publications  are  not  listed. 

1.  T.  Hu  and  Z.  Lin,  Control  Systems  with  Actuator  Saturation:  Analysis  and  Design , 
Birkhauser,  Boston,  xvi,  392  p,  2001. 

Every  physical  actuator  is  subject  to  saturation.  When  the  actuator  saturates,  the  perfor¬ 
mance  of  the  control  system  designed  without  considering  actuator  saturation  will  seriously 
deteriorate.  Currently,  there  is  a  surge  of  interest  in  increasing  the  practical  applicability 
of  control  theory  by  incorporating  the  effect  of  saturation  into  the  design  of  a  control 
system. 

Control  Systems  with  Actuator  Saturation:  Analysis  and  Design  examines  the  problem 
of  actuator  saturation  in  depth.  The  overall  approach  takes  into  account  the  saturation 
nonlinearities  at  the  outset  of  the  control  design.  In  the  case  that  a  control  law  is  designed 
a  priori  to  meet  either  the  performance  or  stability  requirement,  it  analyzes  the  closed-loop 
system  under  actuator  saturation  systematically  and  redesigns  the  controller  in  such  a  way 
that  the  performance  is  retained  while  stability  is  improved.  It  also  presents  some  related 
results  on  systems  with  state  saturation  or  sensor  saturation. 

Features  and  topics: 

•  Results  apply  to  general  open  loop  systems,  including  exponentially  unstable  ones. 
Thus,  they  are  widely  applicable  to  practical  systems. 

•  Problem  such  as  controllability,  stabilizability,  transience  performance,  disturbance 
rejection,  and  output  regulation  are  treated  in  a  systematic  manner. 

•  Analytic  description  of  the  null  controllable  region  is  first  obtained.  Various  feedback 
laws  are  designed  that  work  on  the  entire  null  controllable  region  or  an  arbitrarily 
large  portion  of  it. 

•  Analysis  tools  are  developed  for  performance  assessment  of  existing  control  systems 
under  actuator  saturation. 

•  Examples  are  worked  out  in  detail  to  demonstrate  the  usage  of  the  results  developed. 

2.  X.  Bao,  Z.  Lin  and  E.D.  Sontag,  “Finite  gain  stabilization  of  discrete-time  linear  systems 
subject  to  actuator  saturation,”  Automatica ,  Vol.  36,  No.  2,  pp.  269-277,  February,  2000. 

It  is  shown  that,  for  neutrally  stable  discrete-time  linear  systems  subject  to  actuator 
saturation,  finite  gain  lp  stabilization  can  be  achieved  by  linear  output  feedback,  for  all 
p  €  (1, ooj.  An  explicit  construction  of  the  corresponding  feedback  laws  is  given.  The 
feedback  laws  constructed  also  result  in  a  closed-loop  system  that  is  globally  asymptotically 
stable,  and  in  an  input-to-state  estimate. 

3.  Z.  Lin,  A.  Saberi,  A.  Stoorvogel  and  R.  Mantri,  “An  improvement  to  the  low  gain  design  for 
discrete-time  linear  systems  subject  to  input  saturation  -  solutions  of  semi-global  output 
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regulation  problems,”  International  Journal  of  Robust  and  Nonlinear  Control ,  Vol.  10, 
No.  3,  pp.  117-135,  March,  2000. 

A  low  gain  design  for  linear  discrete-time  systems  subject  to  input  saturation  was  re¬ 
cently  developed  to  solve  both  semi-global  stabilization  and  semi-global  output  regulation 
problems.  This  paper  proposes  an  improvement  to  the  low  gain  design  and  determines 
controllers  with  the  new  design  that  achieve  semi-global  output  regulation.  The  improve¬ 
ment  is  reflected  in  better  utilization  of  available  control  capacity  and  consequently  better 
closed-loop  performance. 

4.  T.  Hu  and  Z.  Lin,  “A  complete  stability  analysis  of  planar  linear  systems  under  satu¬ 
ration,”  IEEE  Transactions  on  Circuits  and  Systems  -  Part  I:  Fundamental  Theory  and 
Applications,  Vol.  47,  No.  4,  pp.  498-512,  April,  2000. 

A  complete  stability  analysis  is  performed  on  a  planar  system  of  the  form  x  =  sat  (Ax), 
where  A  is  a  Hurwitz  matrix  and  sat  is  the  saturation  function.  Necessary  and  sufficient 
conditions  for  the  system.to  be  globally  asymptotically  stable  or  to  have  a  closed  trajectory 
are  explicitly  given  in  terms  of  the  entries  of  A.  These  conditions  also  indicate  that  the 
system  always  has  a  closed  trajectory  if  it  is  not  globally  asymptotically  stable. 

5.  Z.  Lin  and  G.  Tao,  “Adaptive  control  of  a  weakly  nonminimum  phase  linear  system,” 
IEEE  Transactions  on  Automatic  Control,  Vol.  45,  No.  4,  pp.  824-829,  April,  2000. 

For  a  weakly  nonminimum  phase  linear  system,  we  design  an  adaptive  state  feedback 
control  law  that  causes  the  system  output  to  track  a  desired  trajectory  to  an  arbitrarily 
high  degree  of  precision.  The  key  to  this  is  the  use  of  a  low  gain  feedback  design  technique. 

6.  T.  Hu  and  Z.  Lin,  “On  enlarging  the  basin  of  attraction  for  linear  systems  under  saturated 
linear  feedback,”  Systems  &  Control  Letters,  Vol.  40,  No.  1,  pp.  59-69,  May,  2000. 

We  consider  the  problem  of  enlarging  the  basin  of  attraction  for  a  linear  system  under 
saturated  linear  feedback.  An  LMI  based  approach  to  this  problem  is  developed.  For 
discrete-time  system,  this  approach  is  enhanced  by  the  lifting  technique,  which  leads  to 
further  enlargement  of  the  basin  of  attraction.  The  low  convergence  rate  inherent  with  the 
large  invariant  set  (hence,  the  large  basin  of  attraction)  is  prevented  by  the  construction 
of  a  sequence  of  invariant  ellipsoids  nested  within  the  large  one  obtained. 

7.  X.  Bao  and  Z.  Lin,  “On  Lp  input  to  state  stabilizability  of  affine  nonlinear  systems  subject 
to  actuator  saturation,”  Journal  of  the  Franklin  Institute,  Vol.  337,  pp.  691-712,  September, 
2000. 

The  Lp  input  to  state  stabilizability  of  affine  in  control  nonlinear  systems  subject  to  actua¬ 
tor  saturation  is  examined.  A  few  sets  of  conditions  under  which  the  system  is  (finite  gain) 
Lp  input  to  state  stabilizable  are  identified  and  the  stabilizing  feedback  laws  are  explicitly 
constructed. 

8.  T.  Hu  and  Z.  Lin,  “Practical  stabilization  on  the  null  controllable  region  of  exponentially 
unstable  linear  systems  subject  to  actuator  saturation  nonlinearities  and  disturbance,” 
International  Journal  of  Robust  and  Nonlinear  Control,  Vol.  11,  No.  6,  pp.  555-588,  May, 
2001. 

This  paper  investigates  the  problem  of  practical  stabilization  for  linear  systems  subject  to 
actuator  saturation  and  input  additive  disturbance.  Attention  is  restricted  to  systems  with 
two  anti-stable  modes.  For  such  a  system,  a  family  of  linear  feedback  laws  is  constructed 
that  achieves  semi-global  practical  stabilization  on  the  asymptotically  null  controllable 
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region.  This  is  in  the  sense  that,  for  any  set  X0  in  the  interior  of  the  asymptotically  null 
controllable  region,  any  (arbitrarily  small)  set  X^  containing  the  origin  in  its  interior, 
and  any  (arbitrarily  large)  bound  on  the  disturbance,  there  is  a  feedback  law  from  the 
family  such  that  any  trajectory  of  the  closed-loop  system  enters  and  remains  in  the  set 
Xoo  in  a  finite  time  as  long  as  it  starts  from  the  set  X0.  In  proving  the  main  results,  the 
continuity  and  monotonicity  of  the  domain  of  attraction  for  a  class  of  second-order  systems 
are  revealed. 

9.  T.  Hu  and  Z.  Lin,  “A  complete  stability  analysis  of  planar  discrete-time  linear  systems 
under  saturation,”  IEEE  Transactions  on  Circuits  and  Systems  -  Part  I:  Fundamental 
Theory  and  Applications,  Vol.  48,  No.  6,  pp.  710-725,  June,  2001. 

A  complete  stability  analysis  is  performed  on  a  planar  discrete-time  system  of  the  form 
x(k  + 1)  =  sat {Ax{k)),  where  A  is  a  Schur  stable  matrix  and  sat  is  the  saturation  function. 
Necessary  and  sufficient  conditions  for  the  system  to  be  globally  asymptotically  stable  are 
given.  In  the  process  of  establishing  these  conditions,  the  behaviors  of  the  trajectories  are 
examined  in  detail. 

10.  T.  Hu,  Z.  Lin  and  L.  Qiu,  “Stabilization  of  exponentially  unstable  linear  systems  with 
saturating  actuators,”  IEEE  Transactions  on  Automatic  Control,  Vol.  46,  No.  6,  pp.  973- 
979,  June,  2001. 

We  study  the  problem  of  stabilizing  exponentially  unstable  linear  systems  with  saturating 
actuators.  The  study  begins  with  planar  systems  with  both  poles  exponentially  unstable. 
For  such  a  system,  we  show  that  the  boundary  of  the  domain  of  attraction  under  a  satu¬ 
rated  stabilizing  linear  state  feedback  is  the  unique  stable  limit  cycle  of  its  time-reversed 
system.  A  saturated  linear  state  feedback  is  designed  that  results  in  a  closed-loop  system 
having  a  domain  of  attraction  that  is  arbitrarily  close  to  the  null  controllable  region.  This 
design  is  then  utilized  to  construct  state  feedback  laws  for  higher  order  systems  with  two 
exponentially  unstable  poles. 

11.  T.  Hu,  Z.  Lin  and  Y.  Shamash,  “Semi-global  stabilization  with  guaranteed  regional  per¬ 
formance  of  linear  systems  subject  to  actuator  saturation,”  Systems  &  Control  Letters , 
Vol.  43,  No.  3,  pp.  203-210,  July,  2001. 

For  a  linear  system  under  a  given  saturated  linear  feedback,  we  propose  feedback  laws 
that  achieve  semi-global  stabilization  on  the  null  controllable  region  while  preserving  the 
performance  of  the  original  feedback  law  in  a  fixed  region.  Here  by  semi-global  stabilization 
on  the  null  controllable  region  we  mean  the  design  of  feedback  laws  that  result  in  a  domain 
of  attraction  that  includes  any  a  priori  given  compact  subset  of  the  null  controllable  region. 
Our  design  guarantees  that  the  region  on  which  the  original  performance  is  preserved  would 
not  shrink  as  the  domain  of  attraction  is  enlarged  by  appropriately  adjusting  the  feedback 
laws.  Both  continuous-time  and  discrete-time  systems  will  be  considered. 

12.  Z.  Lin  and  T.  Hu,  “Semi-global  stabilization  of  linear  systems  subject  to  output  satura¬ 
tion,”  Systems  &  Control  Letters,  Vol.  43,  No.  3,  pp.  211-217,  July,  2001. 

It  is  established  that  a  SISO  linear  stabilizable  and  detectable  system  subject  to  output 
saturation  can  be  semi-globally  stabilized  by  linear  output  feedback  if  all  its  invariant 
zeros  are  in  the  closed  left-half  plane,  no  matter  where  the  open  loop  poles  are.  This 
result  complements  a  recent  result  that  such  systems  can  always  be  globally  stabilized  by 
discontinuous  nonlinear  feedback  laws,  and  can  be  viewed  as  dual  to  a  well-known  result:  a 
linear  stabilizable  and  detectable  system  subject  to  input  saturation  can  be  semi-globally 
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stabilized  by  linear  output  feedback  if  all  its  poles  are  in  the  open  left-half  plane,  no  matter 
where  the  invariant  zeros  are. 

13.  T.  Hu  and  Z.  Lin,  “Exact  characterization  of  invariant  ellipsoids  for  linear  systems  with 
saturating  actuators,”  IEEE  Transactions  on  Automatic  Control ,  Vol.  47,  No.  1,  pp.  164- 
169,  January  2002. 

We  present  a  necessary  and  sufficient  condition  for  an  ellipsoid  to  be  an  invariant  set  of  a 
linear  system  under  a  saturated  linear  feedback.  The  condition  is  given  in  terms  of  linear 
matrix  inequalities  and  can  be  easily  used  for  optimization  based  analysis  and  design. 

14.  T.  Hu,  Z.  Lin  and  B.M.  Chen,  “Analysis  and  design  for  discrete-time  linear  systems  subject 
to  actuator  saturation,”  Systems  &  Control  Letters ,  Vol.  45,  No.  2,  pp.  97-112,  February 
2002. 

We  present  a  method  to  estimate  the  domain  of  attraction  for  a  discrete-time  linear  system 
under  a  saturated  linear  feedback.  A  simple  condition  is  derived  in  terms  of  an  auxiliary 
feedback  matrix  for  determining  if  a  given  ellipsoid  is  contractive  invariant.  Moreover, 
the  condition  can  be  expressed  as  LMIs  in  terms  of  all  the  varying  parameters  and  hence 
can  easily  be  used  for  controller  synthesis.  The  following  surprising  result  is  revealed 
for  systems  with  single  input:  suppose  that  an  ellipsoid  is  made  invariant  with  a  linear 
feedback,  then  it  is  invariant  under  the  saturated  linear  feedback  if  and  only  if  it  can  be 
made  invariant  with  any  saturated  (nonlinear)  feedback.  Finally,  the  set  invariance  condi¬ 
tion  is  extended  to  determine  the  invariant  sets  for  systems  with  persistent  disturbances. 
LMI  based  methods  are  developed  for  constructing  feedback  laws  that  achieve  disturbance 
rejection  with  guaranteed  stability  requirements. 

15.  T.  Hu,  Z.  Lin  and  B.M.  Chen,  “An  analysis  and  design  method  for  linear  systems  subject 
to  actuator  saturation  and  disturbance,”  Automatical  Vol.  38,  No.  2,  pp.  351-359,  February 
2002. 

We  present  a  method  for  estimating  the  domain  of  attraction  of  the  origin  for  a  system 
under  a  saturated  linear  feedback.  A  simple  condition  is  derived  in  terms  of  an  auxiliary 
feedback  matrix  for  determining  if  a  given  ellipsoid  is  contractive  invariant.  This  condition 
is  shown  to  be  less  conservative  than  the  existing  conditions  which  are  based  on  the  circle 
criterion  or  the  vertex  analysis.  Moreover,  the  condition  can  be  expressed  as  LMIs  in 
terms  of  all  the  varying  parameters  and  hence  can  easily  be  used  for  controller  synthesis. 
This  condition  is  then  extended  to  determine  the  invariant  sets  for  systems  with  persis¬ 
tent  disturbances.  LMI  based  methods  are  developed  for  constructing  feedback  laws  that 
achieve  disturbance  rejection  with  guaranteed  stability  requirements.  The  effectiveness  of 
the  developed  methods  are  illustrated  with  examples. 

16.  Y.-Y.  Cao,  Z.  Lin  and  T.  Hu,  “Stability  analysis  of  linear  time-delay  systems  subject 
to  input  saturation,”  IEEE  Transactions  on  Circuits  and  Systems  -  Part  I:  Fundamental 
Theory  and  Applications ,  Vol.  49,  No.  2,  pp.  233-240,  February  2002. 

This  paper  is  devoted  to  stability  analysis  of  linear  systems  with  state  delay  and  input 
saturation.  The  domain  of  attraction  resulting  from  an  a  priori  designed  state  feedback  law 
is  analyzed  using  Lyapunov-Razumikhin  and  Lyapunov-Krasovskii  functional  approach. 
Both  delay-independent  and  delay-dependent  estimation  of  the  domain  of  attraction  are 
presented  using  the  linear  matrix  inequality  technique.  The  problem  of  designing  linear 
state  feedback  laws  such  that  the  domain  of  attraction  is  enlarged  is  formulated  and 
solved  as  an  optimization  problem  with  LMI  constraints.  Numerical  examples  are  used  to 
demonstrate  the  effectiveness  of  the  proposed  design  technique. 
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17.  Y.-Y.  Cao,  Z.  Lin  and  Y.  Shamash,  “Set  invariance  analysis  and  gain-scheduling  control  for 
LPV  systems  subject  to  actuator  saturation,”  Systems  &  Control  Letters ,  Vol.  46,  No.  2, 
pp.  137-151,  May  2002. 

In  this  paper,  a  set  invariance  analysis  and  gain  scheduling  control  design  approach  is 
proposed  for  the  polytopic  linear  parameter-varying  systems  subject  to  actuator  saturation. 
A  set  invariance  condition  is  first  established.  By  utilizing  this  set  invariance  condition,  the 
design  of  a  time-invariant  state  feedback  law  is  formulated  and  solved  as  an  optimization 
problem  with  LMI  constraints.  A  gain-scheduling  controller  is  then  designed  to  further 
improve  the  closed-loop  performance.  Numerical  examples  are  presented  to  demonstrate 
the  effectiveness  of  the  proposed  analysis  and  design  method. 

18.  T.  Hu,  A.N.  Pitsillides  and  Z.  Lin,  “Null  controllabilility  and  stabilization  of  linear  sys¬ 
tems  subject  to  asymmetric  actuator  saturation,”  in  Actuator  Saturation  Control ,  eds.,  V. 
Kapila  and  K.M.  Grigoriadis,  Dekker,  pp.  47-75,  2002. 

This  paper  generalizes  our  recent  results  on  the  null  controllable  regions  and  the  stabiliz- 
ability  of  exponentially  unstable  linear  systems  subject  to  symmetric  actuator  saturation. 
The  description  of  the  null  controllable  region  carries  smoothly  from  the  symmetric  case 
to  the  asymmetric  case.  As  to  stabilization,  we  have  to  take  a  quite  different  approach 
since  the  development  of  our  earlier  results  for  planar  anti-stable  systems  relies  mainly 
on  the  symmetric  property  of  the  vector  field  and  the  trajectories.  Specifically,  in  this 
paper,  we  construct  a  Lyapunov  function  from  a  closed  trajectory  to  show  that  this  closed 
trajectory  forms  the  boundary  of  the  domain  of  attraction  for  a  planar  anti-stable  system 
under  the  control  of  a  saturated  linear  feedback.  If  the  linear  feedback  is  designed  by  the 
LQR  method,  then  there  is  a  unique  limit  cycle  which  forms  the  boundary  of  the  domain 
of  attraction.  We  further  show  that  if  the  gain  is  increased  along  the  direction  of  the 
LQR  feedback,  then  the  domain  of  attraction  can  be  made  arbitrarily  close  to  the  null 
controllable  region.  This  design  is  then  utilized  to  construct  state  feedback  laws  for  higher 
order  systems  with  two  exponentially  unstable  poles. 

19.  T.  Hu  and  Z.  Lin,  “Output  regulation  of  general  discrete-time  linear  systems  with  satu¬ 
rating  actuators,”  International  Journal  of  Robust  and  Nonlinear  Control ,  to  appear. 

This  paper  studies  the  classical  problem  of  output  regulation  for  linear  discrete-time  sys¬ 
tems  subject  to  actuator  saturation  and  extends  the  recent  results  on  continuous-time 
systems  to  discrete-time  systems.  The  asymptotically  regulatable  region,  the  set  of  all 
initial  conditions  of  the  plant  and  the  exosystem  for  which  the  asymptotic  output  regula¬ 
tion  is  possible,  is  characterized  in  terms  of  the  null  controllable  region  of  the  anti-stable 
subsystem  of  the  plant.  Feedback  laws  are  constructed  that  achieve  regulation  on  the 
asymptotically  regulatable  region. 

20.  T.  Hu  and  Z.  Lin,  “On  semi-global  stabilizability  of  anti-stable  systems  by  saturated  linear 
feedback,”  IEEE  Transactions  on  Automatic  Control,  to  appear. 

It  was  recently  established  that  a  second-order  anti-stable  linear  system  can  be  semi- 
globally  stabilized  on  its  null  controllable  region  by  saturated  linear  feedback  and  a  higher 
order  linear  system  with  two  or  more  anti-stable  poles  can  be  semi-globally  stabilized 
on  its  null  controllable  region  by  more  general  bounded  feedback  laws.  We  will  show  in 
this  paper  that  a  system  with  three  real-valued  anti-stable  poles  cannot  be  semi-globally 
stabilized  on  its  null  controllable  region  by  the  simple  saturated  linear  feedback. 

21.  T.  Hu,  Z.  Lin  and  L.  Qiu,  “An  explicit  description  of  null  controllable  region  of  linear 
systems  with  saturating  actuators,  Systems  &  Control  Letters,  to  appear. 
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We  give  simple  exact  descriptions  of  the  null  controllable  regions  for  general  linear  systems 
with  saturating  actuators.  The  description  is  in  terms  of  a  set  of  extremal  trajectories  of 
the  anti-stable  subsystem.  For  lower  order  systems  or  systems  with  only  real  eigenvalues, 
this  description  is  further  simplified  to  result  in  explicit  formulae  for  the  boundaries  of  the 
null  controllable  regions. 

22.  T.  Hu  and  Z.  Lin,  “On  improving  the  performance  with  continuous  feedback  laws,”  IEEE 
Transactions  on  Automatic  Control,  to  appear. 

We  present  controller  design  methods  to  smoothen  the  discontinuity  resulting  from  a  piece- 
wise  linear  control  (PLC)  law  which  was  proposed  to  improve  the  convergence  performance 
for  systems  with  input  constraints.  The  continuous  control  laws  designed  in  this  paper  are 
explicit  functions  of  the  state  and  are  easily  implementable.  We  also  show  that  the  conver¬ 
gence  performance  can  be  further  improved  by  using  a  saturated  high  gain  feedback  law. 
The  efficiency  of  the  proposed  methods  is  illustrated  with  the  PUMA  560  robot  model. 

23.  T.  Hu  and  Z.  Lin,  “Compiste  quadratic  Lyapunov  functions  for  constrained  control  sys¬ 
tems,”  submitted  for  publication  in  IEEE  Transactions  on  Automatic  Control. 

A  Lyapunov  function  based  on  a  group  of  quadratic  functions  is  introduced  in  this  paper. 
We  call  this  Lyapunov  function  a  composite  quadratic  function.  Some  important  proper¬ 
ties  of  this  Lyapunov  function  are  revealed.  We  show  that  this  function  is  continuously 
differentiable  and  its  level  set  is  the  convex  hull  of  a  group  of  ellipsoids.  These  results 
are  used  to  study  the  set  invariance  properties  of  linear  systems  with  input  and  state  con¬ 
straints.  We  show  that  for  a  system  under  a  given  saturated  linear  feedback,  the  convex 
hull  of  a  group  of  invariant  ellipsoids  is  also  invariant.  If  each  ellipsoid  in  a  group  can  be 
made  invariant  with  a  bounded  control  of  the  saturating  actuator,  then  their  convex  hull 
can  also  be  made  invariant  by  the  same  actuator.  For  a  group  of  ellipsoids,  each  invariant 
under  a  separate  saturated  linear  feedback,  we  also  present  a  method  for  constructing  a 
nonlinear  continuous  feedback  law  which  makes  their  convex  hull  invariant. 

24.  T.  Hu  and  Z.  Lin,  “The  equivalence  of  several  set  invariance  conditions  under  saturation,” 
submitted  for  publication  in  IEEE  Transactions  on  Automatic  Control. 

Several  equivalent  conditions  or  statements  for  set  invariance  were  obtained  for  systems 
with  one  saturating  actuator  in  a  recent  paper.  In  particular,  it  was  shown  that  the 
invariance  of  an  ellipsoid  under  a  saturated  linear  feedback  is  equivalent  to  its  controlled 
invariance  and  also  to  the  existence  of  a  feedback  linear  inside  the  ellipsoid  that  makes 
it  invariant.  In  this  paper,  we  attempt  to  extend  the  results  to  systems  with  multiple 
saturating  actuators.  Our  analysis  reveals  that  the  equivalence  holds  conditionally  for 
some  pairs  of  the  statements  and  does  not  hold  for  some  other  pairs. 

25.  T.  Hu  and  Z .  Lin,  “On  the  necessity  of  a  recent  set  invariance  condition  under  actuator 
saturation,”  submitted  for  publication  in  Systems  &  Control  Letters. 

A  sufficient  condition  for  an  ellipsoid  to  be  invariant  was  obtained  recently  and  an  LMI 
approach  was  developed  to  find  the  largest  ellipsoid  satisfying  the  condition.  This  condition 
was  later  shown  to  be  necessary  for  the  single  input  case.  This  paper  is  dedicated  to  the 
multi-input  case.  We  will  examine  when  this  condition  is  also  necessary  for  multi-input 
systems.  Our  investigation  is  based  on  studying  the  optimal  solution  to  a  related  LMI 
problem.  A  criterion  is  presented  to  determine  when  the  condition  is  necessary  and  when 
the  largest  invariant  ellipsoid  has  been  obtained  by  using  the  LMI  method. 
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26.  T.  Hu,  Z.  Lin  and  Y.  Shamash,  “On  maximizing  the  convergence  rate  for  linear  linear 
systems  with  input  saturation,”  submitted  for  publication  in  IEEE  Transactions  on  Au¬ 
tomatic  Control. 

In  this  paper,  we  consider  the  problem  of  maximizing  the  convergence  rate  inside  a  given 
level  set  for  both  continuous-time  and  discrete-time  systems  with  input  saturation.  We  also 
provide  simple  methods  for  finding  the  largest  ellipsoid  of  a  given  shape  that  can  be  made 
invariant  with  a  saturated  control.  For  the  continuous-time  case,  the  maximal  convergence 
rate  is  achieved  by  a  bang-bang  type  control  with  a  simple  switching  scheme.  Sub-optimal 
convergence  rate  can  be  achieved  with  saturated  high-gain  linear  feedback.  We  also  study 
the  problem  of  maximizing  the  convergence  rate  in  the  presence  of  disturbances.  For  the 
discrete-time  case,  the  maximal  convergence  rate  is  achieved  by  a  coupled  saturated  linear 
feedback. 

27.  T.  Hu  and  Z.  Lin,  “Output  regulation  for  general  linear  systems  with  saturating  actuators,” 
submitted  for  publication  in  Automatica. 

This  paper  studies  the  classical  problem  of  output  regulation  for  linear  systems  subject  to 
actuator  saturation.  The  asymptotically  regulatable  region,  the  set  of  all  initial  conditions 
of  the  plant  and  the  exosystem  for  which  output  regulation  is  possible,  is  characterized 
in  terms  of  the  null  controllable  region  of  the  anti-stable  subsystem  of  the  plant.  Output 
regulation  laws  are  constructed  from  a  given  stabilizing  state  feedback  law.  It  is  shown  that 
a  stabilizing  feedback  law  that  achieves  a  larger  domain  of  attraction  leads  to  a  feedback  law 
that  achieves  output  regulation  on  a  larger  subset  of  the  asymptotically  regulatable  region. 
A  feedback  law  that  achieves  global  stabilization  on  the  asymptotically  null  controllable 
region  leads  to  a  feedback  law  that  achieves  output  regulation  on  the  entire  asymptotically 
regulatable  region. 

28.  Y.  Xiao,  Y.-Y.  Cao  and  Z.  Lin,  “Robust  filtering  for  discrete-time  systems  with  saturation 
and  its  application  to  transmultiplexers,”  submitted  for  publication  in  IEEE  Transactions 
on  Signal  Processing. 

This  paper  considers  the  problem  of  robust  filtering  for  discrete-time  linear  systems  subject 
to  saturation.  A  generalized  dynamic  filter  architecture  is  proposed  and  a  filter  design 
method  is  developed.  Our  approach  incorporates  the  conventional  linear  H%  and 
filtering  as  well  as  a  regional  h  gain  filtering  feature  developed  specially  for  the  saturation 
nonlinearity,  and  is  applicable  to  the  digital  transmultiplexer  systems  for  the  purpose 
of  separating  filter  bank  design.  It  turns  out  that  our  filter  design  can  be  carried  out 
by  solving  a  constrained  optimization  problem  with  LMI  constraints.  Simulation  shows 
that  the  resultant  separating  filters  possess  satisfactory  reconstruction  performance  while 
working  in  the  linear  range,  and  less  degraded  reconstruction  performance  in  the  presence 
of  saturation. 

29.  Y.-Y.  Cao  and  Z.  Lin,  “Robust  stability  analysis  and  fuzzy-scheduling  control  for  nonlinear 
systems  subject  to  actuator  saturation,”  submitted  for  publication  in  IEEE  Transactions 
on  Fuzzy  Systems. 

Takagi-Sugeno  (TS)  fuzzy  models  can  provide  an  effective  representation  of  complex  non¬ 
linear  systems  in  terms  of  fuzzy  sets  and  fuzzy  reasoning  applied  to  a  set  of  linear  input- 
output  submodels.  In  this  paper,  the  TS  fuzzy  modeling  approach  is  utilized  to  carry 
out  the  stability  analysis  and  control  design  for  nonlinear  systems  with  actuator  satura¬ 
tion.  The  TS  fuzzy  representation  of  a  nonlinear  system  subject  to  actuator  saturation 
is  presented.  In  our  TS  fuzzy  representation,  the  modeling  error  is  also  captured  by 
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norm-bounded  uncertainties.  A  set  invariance  condition  for  the  system  in  the  TS  fuzzy 
representation  is  first  established.  Based  on  this  set  invariance  condition,  the  problem  of 
estimating  the  domain  of  attraction  of  a  TS  fuzzy  system  under  a  constant  state  feed¬ 
back  law  is  formulated  and  solved  as  an  LMI  optimization  problem.  By  viewing  the  state 
feedback  gain  as  an  extra  free  parameter  in  the  LMI  optimization  problem,  we  arrive  at 
a  method  for  designing  state  feedback  gain  that  maximizes  the  domain  of  attraction.  A 
fuzzy  scheduling  control  design  method  is  also  introduced  to  further  enlarge  the  domain  of 
attraction.  An  inverted  pendulum  is  used  to  show  the  effectiveness  of  the  proposed  fuzzy 
controller. 


3  Future  Research  Topics 

There  are  several  research  topics  important  to  current  research  program.  In  what  follows,  we 
briefly  describe  three  of  these  research  topics. 

1.  Intelligent  Control  of  Nonlinear  Systems  with  Actuator  Saturation 

Saturation  is  probably  the  most  widely  encountered  and  most  dangerous  nonlinearity  in 
control  systems.  Actuator  saturation  is  a  particularly  important  consideration  in  recon- 
figurable  control  systems.  Following  a  system  failure,  it  is  likely  that  the  available  control 
authority  will  be  reduced,  and  that  the  reconfigurable  control  system  will  drive  actuators 
into  their  saturated  regime  to  stabilize  the  systems  and  to  attempt  to  regain  nominal  per¬ 
formance.  The  destabilizing  effects  of  actuator  saturation  have  been  cited  as  contributing 
factors  in  several  mishaps  involving  high  performance  aircraft.1  2  3  As  a  result,  actuator 
saturation  has  been  receiving  increasing  attention  from  research  community.  Most  of  these 
results  however  deal  with  Unear  systems  that  are  at  worst  marginally  unstable.  Results 
that  do  deal  with  unstable  systems  are  often  conservative.  However,  the  dynamics  of 
many  control  systems  such  as  flight  control  systems  are  nonlinear  and  their  linearizations 
are  strictly  unstable. 

Under  the  support  of  this  YIP  award,  we  have  been  studying  unstable  linear  systems  with 
saturating  actuators  and  have  obtained  several  fundamental  results.4  In  particular,  we 
have  for  the  first  time  obtained  an  explicit  characterization  of  the  null  controllable  region, 
the  set  of  states  that  can  be  driven  to  the  origin  using  bounded  controls  delivered  by  the 
saturating  actuators.  We  have  also  constructed  feedback  laws  that  actually  stabilize  the 
system  on  an  arbitrarily  large  portion  of  the  null  controllable  region.  These  results  and 
the  experience  gained  in  obtaining  these  results  prepared  us  to  tackle  the  more  difficult 
problem  of  control  design  for  nonlinear  systems  with  actuator  saturation. 

Our  approach  is  inspired  by  the  TS  fuzzy  models  as  originally  proposed  by  Takagi  and 
Sugeno.5  The  idea  is  to  represent  a  nonlinear  system  subject  to  actuator  saturation  by  a 
fuzzy  blending  of  a  group  of  (possibly  strictly  unstable)  linear  systems  subject  to  actuator 
saturation.  Such  a  fuzzy  blended  model  takes  the  form  of  an  linear  parameter  varying 
(LPV)  systems  with  the  parameter  varying  within  a  polytope  V.  Corresponding  to  each 

1J.M.  Lenorovitz,  “Gripen  control  problems  resolved  through  in-flight,  ground  simulations,”  Aviation  Week 
Space  Technol. ,  pp.  74-75,  June  18,  1990. 

2M.A.  Dornheim,  “Report  pinpoints  factors  leading  to  YF-22  crash,”  Aviation  Week  Space  Technol,  pp.  53-54, 
Nov.  9,  1992. 

3C.A.  Shifrin,  “Gripen  likely  to  fly  again  soon,”  Aviation  Week  Space  Technol ,  pp.  72,  Aug.  23,  1993. 

4T.  Hu  and  Z.  Lin,  Control  Systems  with  Actuator  Saturation:  Analysis  and  Design ,  Birkauser,  Boston,  2001 

5T.  Takagi  and  M.  Sugeno,  “Fuzzy  identification  of  systems  and  its  applications  to  modeling  and  control,” 
IEEE  Trans.  Sys.,  Man,  Cybern .,  Vol.  15,  No.  1,  PP.  116-132,  1985. 


10 


vertex  of  the  polytope  is  a  linear  system  subject  to  actuator  saturation.  A  control  law 
is  then  designed  for  each  of  these  linear  systems  subject  to  actuator  saturation.  These 
“local”  control  laws  are  then  fuzzy  blended  to  form  the  overall  controller  for  the  original 
nonlinear  systems. 

Preliminary  work  as  reported  in  our  Publication  29  of  Section  2  has  indicated  the  power 
of  combining  the  results  developed  in  this  project  with  the  tools  from  intelligent  control 
theory. 

2.  Time  Delay  in  Networked  Systems 

Time  delay  is  probably  one  of  the  most  important  issues  to  be  considered  in  networked 
systems.  Although  there  is  a  vast  literature  on  control  systems  with  time  delays,  the 
analysis  and  design  methods  that  take  into  account  practical  constraints  such  as  actuator 
saturation  are  very  conservative.  In  our  preliminary  work,  Publication  16  of  Section  2,  we 
have  been  able  to  demonstrate  how  the  theory  developed  under  this  YIP  project  can  be 
readily  applied  to  drastically  sharpen  the  analysis  and  design  tools  for  systems  with  time 
delay. 

Our  work  as  reported  in  Publication  16  of  Section  2  only  deals  with  stability.  The  next 
step  is  to  address  closed-loop  system  performances  beyond  stability. 

3.  Large  Scale  Systems  with  Limited  Information 

Many  large  scale  systems,  such  as  a  group  of  UCAVs  working  as  a  networked  system, 
require  the  control  action  be  designed  and  implemented  locally,  because  of  the  lack  of  cen¬ 
tralized  information.  Control  design  becomes  more  complicated  when  physical  constraints 
such  as  time  delay  and  imperfect  actuators/sensors  have  to  be  taken  into  account.  For 
example,  in  the  design  of  local  controllers,  the  limited  information  available  to  the  subsys¬ 
tems  are  probably  transmitted  from  other  subsystems  with  some  time  delay.  Many  Sensors 
cannot  provide  precise  information.  Sensors  might  have  finite  precision  when  the  signal  to 
be  sensed  is  small.  Sensors  might  even  only  be  able  to  pick  up  the  sign  of  the  signal  to  be 
sensed.  Analysis  and  design  tools  for  large  scale  systems  with  limited  information  is  an 
important  research  topic. 

The  benefit  of  understanding  the  adverse  effects  of  limited  information  and  imperfect 
sensors  and  knowing  ways  of  alleviating  these  effects  is  two  fold.  First,  we  will  be  able 
to  fully  utilize  the  available  information  and  the  precision  of  sensors  without  worrying 
about  their  adverse  effects.  On  the  other  hand,  by  being  able  to  fully  utilize  the  lim¬ 
ited  information  and  limited  sensor  precision,  we  will  be  able  to  use  the  fewest  and  least 
sophisticated/expensive  sensors  to  achieve  the  desired  closed-loop  system  performance. 


11 


4 


Appendix:  Copies  of  Publications 


Publication  1 

Table  of  Contents6 
Preface 


6A  copy  of  the  book  was  earlier  presented  to  Dr.  Moshfegh. 


12 


§£•’ 


Birkhauser 


S'**;  **£i  i*~’S 


Contents 


Preface  xiii 

1  Introduction  1 

1.1  Linear  Systems  with  Actuator  Saturation .  1 

1.2  Notation,  Acronyms,  and  Terminology .  3 

2  Null  Controllability  -  Continuous-Time  Systems  11 

2.1  Introduction .  11 

2.2  Preliminaries  and  Definitions .  12 

2.3  General  Description  of  Null  Controllable  Region  .  15 

2.4  Systems  with  Only  Real  Eigenvalues .  21 

2.5  Systems  with  Complex  Eigenvalues .  27 

2.6  Some  Remarks  on  the  Description  of  C(T) .  33 

2.7  Asymptotically  Null  Controllable  Region .  34 

2.8  Conclusions .  35 

3  Null  Controllability -Discrete-Time  Systems  37 

3.1  Introduction .  37 

3.2  Preliminaries  and  Definitions .  38 

3.3  General  Description  of  Null  Controllable  Region  .  41 

3.4  Systems  with  Only  Real  Eigenvalues .  44 

3.5  Systems  with  Complex  Eigenvalues .  48 

3.6  An  Example . 50 

3.7  Asymptotically  Null  Controllable  Region .  51 

3.8  Conclusions .  53 

vii 


YI11 


Contents 


4  Stabilization  on  Null  Controllable  Region  — 

Continuous-Time  Systems  55 

4.1  Introduction .  55 

4.2  Domain  of  Attraction -Planar  System  under 

Saturated  Linear  Feedback  .  57 

4.3  Semi-Global  Stabilization -Planar  Systems  .  67 

4.4  Semi-Global  Stabilization -Higher  Order  Systems .  74 

4.5  Conclusions .  83 

5  Stabilization  on  Null  Controllable  Region  - 

Discrete-Time  Systems  85 

5.1  Introduction . .  85 

5.2  Global  Stabilization  at  Set  of  Equilibria  - 

Planar  Systems .  86 

5.3  Global  Stabilization- Planar  Systems .  99 

5.4  Semi-Global  Stabilization -Planar  Systems  .  105 

5.5  Semi-Global  Stabilization -Higher  Order  Systems .  108 

5.6  Conclusions .  Ill 

6  Practical  Stabilization  on  Null  Controllable  Region  113 

6.1  Introduction .  113 

6.2  Problem  Statement  and  Main  Results .  114 

6.2.1  Problem  Statement  . .  114 

6.2.2  Main  Results:  Semi-Global  Practical  Stabilization  .  114 

6.3  Proof  of  Main  Results .  115 

6.3.1  Properties  of  the  Trajectories  of  Second  Order 

Linear  Systems .  115 

6.3.2  Properties  of  the  Domain  of  Attraction  .  119 

6.3.3  Proof  of  Theorem  6.2.1:  Second  Order  Systems  .  .  .  127 

6.3.4  Proof  of  Theorem  6.2.1:  Higher  Order  Systems  .  .  .  141 

6.4  An  Example .  144 

6.5  Conclusions .  147 

6. A  Proof  of  Lemma  6.3.1  .  149 

6.B  Proof  of  Lemma  6.3.2  .  153 

7  Estimation  of  the  Domain  of  Attraction  under 

Saturated  Linear  Feedback  157 

7.1  Introduction .  157 


Contents 


IX 


7.2  A  Measure  of  Set  Size .  159 

7.3  Some  Facts  about  Convex  Hulls .  160 

7.4  Continuous-Time  Systems  under  State  Feedback .  163 

7.4.1  A  Set  Invariance  Condition  Based  on 

Circle  Criterion .  164 

7.4.2  An  Improved  Condition  for  Set  Invariance  ......  165 

7.4.3  The  Necessary  and  Sufficient  Condition-  ■ 

Single  Input  Systems .  167 

7.4.4  Estimation  of  the  Domain  of  Attraction .  169 

7.5  Discrete-Time  Systems  under  State  Feedback . 173 

7.5.1  Condition  for  Set  Invariance .  173 

7.5.2  The  Necessary  and  Sufficient  Condition  - 

Single  Input  Systems .  177 

7.5.3  Estimation  of  the  Domain  of  Attraction . 179 

7.6  Extension  to  Output  Feedback .  180 

7.7  Conclusions .  181 

8  On  Enlarging  the  Domain  of  Attraction  183 

8.1  Introduction .  183 

8.2  Continuous-Time  Systems .  183 

8.3  Discrete-Time  Systems .  185 

8.4  Conclusions .  191 

9  Semi-Global  Stabilization  with  Guaranteed 

Regional  Performance  195 

9.1  Introduction .  195 

9.2  Expansion  of  the  Domain  of  Attraction  .  197 

9.3  Semi-Globalization -Discrete-Time  Systems . 199 

9.4  Semi-Globalization -Continuous-Time  Systems . 205 

9.5  An  Example .  207 

9.6  Conclusions .  208 

10  Disturbance  Rejection  with  Stability  211 

10.1  Introduction .  211 

10.2  Continuous-Time  Systems .  213 

10.2.1  Problem  Statement . 213 

10.2.2  Condition  for  Set  Invariance . 214 


X 


Contents 


10.2.3  Disturbance  Rejection  with  Guaranteed  Domain 

of  Attraction .  216 

10.2.4  An  Example  .  219 

10.3  Discrete-Time  Systems .  221 

10.3.1  Problem  Statement .  221 

10.3.2  Condition  for  Set  Invariance .  223 

10.3.3  Disturbance  Rejection  with  Guaranteed  Domain 

of  Attraction .  225 

10.4  Conclusions .  228 

11  On  Maximizing  the  Convergence  Rate  229 

11.1  Introduction .  229 

11.2  Continuous-Time  Systems .  233 

11.2.1  Maximal  Convergence  Control  and  Maximal 

Invariant  Ellipsoid .  233 

11.2.2  Saturated  High  Gain  Feedback .  242 

11.2.3  Overall  Convergence  Rate .  247 

11.2.4  Maximal  Convergence  Control  in  the  Presence 

of  Disturbances .  255 

11.3  Discrete-Time  Systems . 258 

11.4  Conclusions .  264 

12  Output  Regulation- Continuous-Time  Systems  265 

12.1  Introduction .  265 

12.2  Preliminaries  and  Problem  Statement .  267 

12.2.1  Review  of  Linear  Output  Regulation  Theory  ....  267 

12.2.2  Output  Regulation  in  the  Presence  of 

Actuator  Saturation .  270 

12.3  The  Regulatable  Region .  271 

12.4  State  Feedback  Controllers  .  279 

12.5  Error  Feedback  Controllers .  290 

12.6  An  Example .  297 

12.7  Conclusions .  301 

13  Output  Regulation- Discrete-Time  Systems  305 

13.1  Introduction .  305 

13.2  Preliminaries  and  Problem  Statement  .  306 

13.2.1  Review  of  Linear  Output  Regulation  Theory  ....  306 


Contents  xi 


13.2.2  Output  Regulation  in  the  Presence  of 

Actuator  Saturation . 307 

13.3  The  Regulatable  Region .  309 

13.4  State  Feedback  Controllers  .  315 

13.5  Error  Feedback  Controllers . 324 

13.6  Conclusions . 325 

14  Linear  Systems  with  Non- Actuator  Saturation  327 

14.1  Introduction . 327 

14.2  Planar  Linear  Systems  under  State  Saturation - 

Continuous-Time  Systems .  328 

14.2.1  System  Description  and  Problem  Statement . 328 

14.2.2  Main  Results  on  Global  Asymptotic  Stability  ....  328 

14.2.3  Outline  of  the  Proof . 330 

14.3  Planar  Linear  Systems  under  State  Saturation - 

Discrete-Time  Systems . 344 

14.3.1  System  Description  and  Problem  Statement . 344 

14.3.2  Main  Results  on  Global  Asymptotic  Stability  ....  344 

14.3.3  Outline  of  the  Proof . 347 

14.4  Semi-Global  Stabilization  of  Linear  Systems 

Subject  to  Sensor  Saturation . 362 

14.4.1  Introduction  . 362 

14.4.2  Main  Results . 363 

14.4.3  An  Example  . 370 

14.5  Conclusions . 371 

Bibliography  375 


Index 


387 


Preface 


Saturation  nonlinearities  are  ubiquitous  in  engineering  systems.  In  control 
systems,  every  physical  actuator  or  sensor  is  subject  to  saturation  owing  to 
its  maximum  and  minimum  limits.  A  digital  filter  is  subject  to  saturation  if 
it  is  implemented  in  a  finite  word  length  format.  Saturation  nonlinearities 
are  also  purposely  introduced  into  engineering  systems  such  as  control  sys¬ 
tems  and  neural  network  systems.  Regardless  of  how  saturation  arises,  the 
analysis  and  design  of  a  system  that  contains  saturation  nonlinearities  is 
an  important  problem.  Not  only  is  this  problem  theoretically  challenging, 
but  it  is  also  practically  imperative.  This  book  intends  to  study  control 
systems  with  actuator  saturation  in  a  systematic  way.  It  will  also  present 
some  related  results  on  systems  with  state  saturation  or  sensor  saturation. 

Roughly  speaking,  there  are  two  strategies  for  dealing  with  actuator  sat¬ 
uration.  The  first  strategy  is  to  neglect  the  saturation  in  the  first  stage  of 
the  control  design  process,  and  then  to  add  some  problem-specific  schemes 
to  deal  with  the  adverse  effects  caused  by  saturation.  These  schemes,  known 
as  anti- windup  schemes,  are  typically  introduced  using  ad  hoc  modifications 
and  extensive  simulations.  The  basic  idea  behind  these  schemes  is  to  intro¬ 
duce  additional  feedbacks  in  such  a  way  that  the  actuator  stays  properly 
within  its  limits.  Most  of  these  schemes  lead  to  improved  performance  but 
poorly  understood  stability  properties. 

The  second  strategy  is  more  systematic.  It  takes  into  account  the  sat¬ 
uration  nonlinearities  at  the  outset  of  the  control  design.  Or,  in  the  case 
that  a  control  law  is  designed  a  priori  to  meet  either  the  performance  or 
stability  requirement,  it  analyzes  the  closed-loop  system  under  actuator 
saturation  systematically  and  redesigns  the  controller  in  such  a  way  that 
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the  performance  is  retained  while  stability  is  improved  or  the  other  way 
around.  This  is  the  approach  we  will  take  in  this  book.  Such  an  approach 
to  dealing  with  actuator  saturation  entails  the  characterization  of  the  null 
controllable  region,  the  set  of  all  states  that  can  be  driven  to  the  origin  by 
the  saturating  actuators,  and  the  design  of  feedback  laws  that  are  valid  on 
the  entire  null  controllable  region  or  a  large  portion  of  it.  More  specifically, 
the  results  that  are  to  be  presented  in  this  book  are  outlined  as  follows. 

In  Chapter  1,  after  a  short  introduction  to  linear  systems  with  saturation 
nonlinearities,  in  particular,  actuator  saturation,  we  list  some  notation  and 
acronyms  that  are  used  throughout  the  book.  Some  technical  terms  will 
also  be  defined  here. 

Chapters  2  and  3  give  explicit  descriptions  of  the  null  controllable  region 
of  a  linear  system  with  the  bounded  controls  delivered  by  the  saturating 
actuators.  Chapter  2  deals  with  continuous-time  systems.  Chapter  3  deals 
with  discrete-time  systems. 

Chapters  4  and  5  study  the  stabilizability  at  the  origin  of  linear  systems 
with  saturating  actuators.  The  main  objective  is  to  obtain  a  domain  of 
attraction  that  is  arbitrarily  close  to  the  null  controllable  region.  We  refer 
to  such  a  stabilization  problem  as  semi-global  stabilization  on  the  null  con¬ 
trollable  region.  Chapter  4  deals  with  continuous-time  systems.  Chapter  5 
deals  with  discrete-time  systems. 

Chapter  6  considers  continuous-time  linear  systems  that  are  subject  to 
both  actuator  saturation  and  input-additive  bounded  disturbance.  The 
objective  is  to  construct  feedback  laws  that  will  cause  all  trajectories  start¬ 
ing  from  within  any  a  priori  specified  (arbitrarily  large)  compact  subset  of 
the  null  controllable  region  to  converge  to  another  a  priori  specified  (arbi¬ 
trarily  small)  neighborhood  of  the  origin.  We  refer  to  such  a  problem  as 
semi-global  practical  stabilization  on  the  null  controllable  region. 

Chapter  7  looks  at  the  problem  of  controlling  a  linear  system  with  satu¬ 
rating  actuators  from  a  different  angle.  An  LMI-based  method  is  developed 
for  estimating  the  domain  of  attraction  of  a  linear  system  under  an  a  pri¬ 
ori  designed  saturated  linear  feedback  law.  This  analysis  method  is  then 
utilized  in  Chapter  8  to  arrive  at  a  method  for  designing  linear  state  feed¬ 
back  laws  that  would  result  in  the  largest  estimated  domain  of  attraction. 
Each  of  these  two  chapters  treats  both  continuous-time  and  discrete-time 
systems. 
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Chapter  9  develops  a  design  method  for  arriving  at  simple  nonlinear 
feedback  laws  that  achieve  semi-global  stabilization  on  the  null  control¬ 
lable  region  and,  in  the  mean  time,  guarantee  regional  performance.  Both 
continuous-time  and  discrete-time  systems  are  considered. 

Chapter  10  addresses  the  problem  of  controlling  linear  systems  subject 
to  both  actuator  saturation  and  disturbance.  Unlike  in  Chapter  6,  here 
the  disturbance  is  not  input  additive  and  can  enter  the  system  from  any¬ 
where.  Design  problems  that  capture  both  large  domains  of  attraction  and 
strong  disturbance  rejection  capability  are  formulated  and  solved.  Both 
continuous-time  and  discrete-time  systems  are  considered. 

Chapter  11  examines  the  problem  of  maximizing  the  convergence  rate 
inside  a  given  ellipsoid  for  both  continuous-time  and  discrete-time  systems 
subject  to  actuator  saturation.  Simple  methods  are  also  proposed  for  de¬ 
termining  the  largest  ellipsoid  of  a  given  shape  that  can  be  made  invariant 
with  a  saturated  control.  For  continuous-time  systems,  the  maximal  conver¬ 
gence  rate  is  achieved  by  a  bang-bang  type  control  with  a  simple  switching 
scheme.  A  sub-optimal  convergence  rate  can  be  achieved  with  saturated 
high-gain  linear  feedback.  For  discrete-time  systems,  the  maximal  conver¬ 
gence  rate  is  achieved  by  a  coupled  saturated  linear  feedback. 

Chapters  12  and  13  formulate  and  solve  the  classical  problem  of  output 
regulation  for  linear  systems  with  saturating  actuators.  The  problem  is  to 
design  stabilizing  feedback  laws  that,  in  the  presence  of  disturbances,  cause 
the  plant  output  to  track  reference  signals  asymptotically.  Both  the  refer¬ 
ence  signals  and  the  disturbances  are  modeled  by  a  reference  system,  called 
the  exosystem.  The  asymptotically  regulatable  region,  the  set  of  all  initial 
conditions  of  the  plant  and  the  exosystem  for  which  the  output  regulation 
is  possible,  is  characterized.  Feedback  laws  that  achieve  output  regula¬ 
tion  on  the  asymptotically  regulatable  region  are  constructed.  Chapter  12 
deals  with  continuous-time  systems.  Chapter  13  deals  with  discrete-time 
systems. 

Finally,  Chapter  14  collects  some  results  on  the  analysis  and  design  of 
linear  systems  subject  to  saturation  other  than  actuator  saturation.  This 
includes  sensor  saturation  and  state  saturation. 

The  intended  audience  of  this  monograph  includes  practicing  engineers 
and  researchers  in  areas  related  to  control  engineering.  An  appropriate 
background  for  this  monograph  would  be  some  first  year  graduate  courses 


XVI 


Preface 


in  linear  systems  and  multivariable  control.  Some  background  in  nonlinear 
control  systems  would  greatly  facilitate  the  reading  of  the  book. 

In  such  an  active  current  research  area  as  actuator  saturation,  it  is 
impossible  to  account  for  all  the  available  results.  Although  we  have  tried 
our  best  to  relate  our  work  to  the  available  research,  we  are  still  frustrated 
with  our  inability  to  do  a  better  job  in  this  regard  and  will  strive  to  improve 
in  future  work. 

We  would  like  to  thank  some  of  our  colleagues  who,  through  collabora¬ 
tion  on  the  topics  of  this  book,  motivated  and  helped  us  in  many  ways.  They 
are  Professor  Ben  M.  Chen  of  National  University  of  Singapore,  Profes¬ 
sor  Daniel  Miller  of  University  of  Waterloo,  Professor  Li  Qiu  of  Hong  Kong 
University  of  Science  and  Technology,  and  Professor  Yacov  Shamash  of 
State  University  of  New  York  at  Stony  Brook.  We  would  also  like  to  thank 
our  colleague  Dr.  Yong-Yan  Cao  for  a  careful  reading  of  the  manuscript. 

We  are  indebted  to  Professor  William  S.  Levine,  the  series  editor,  for 
his  enthusiasm  and  encouragement  of  our  efforts  in  completing  this  book. 
We  are  also  thankful  to  the  staff  at  Birkhauser,  in  particular,  Ms.  Louise 
Farkas,  Ms.  Shoshanna  Grossman,  and  Ms.  Lauren  Schultz,  for  their  excel¬ 
lent  editorial  assistance. 

We  are  grateful  to  the  United  States  Office  of  Naval  Research’s  Young 
Investigator  Program  for  supporting  our  research  that  leads  to  most  of  the 
results  presented  in  this  book.  We  are  also  grateful  to  the  University  of 
Virginia  for  an  environment  that  allowed  us  to  write  this  book. 

Our  special  thanks  go  to  our  families,  {Jianping,  Sylvia,  (T.  H.)}  and 
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Abstract 

It  is  shown  that,  for  neutrally  stable  discrete-time  linear  systems  subject  to  actuator  saturation,  finite  gain  /psta  bilization  can  be 
achieved  by  linear  output  feedback,  for  all  pe(l,  oo].  An  explicit  construction  of  the  corresponding  feedback  laws  is  given.  The 
feedback  laws  constructed  also  result  in  a  closed-loop  system  that  is  globally  asymptotically  stable,  and  in  an  input-to-state 
estimate.  ©  1999  Elsevier  Science  Ltd.  All  rights  reserved. 
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1.  Introduction 

In  this  paper,  we  consider  the  problem  of  global 
stabilization  of  a  discrete-time  linear  system  subject  to 
actuator  saturation: 

fx+  =  Ax  +  Bo{u  +  ux\  xgR",  ueUm, 

3h\  (1) 

{j  =  Cx  +  u2,  ye  UT 

(we  use  the  notation  x+  to  indicate  a  forward  shift,  that 
is,  for  a  function  x  and  an  integer  t ,  x+(t)  is  x(t  +  1)), 
where  ux  e  IRm  is  the  actuator  disturbance,  u2  e  Ur  is 
the  sensor  noise,  and  a:Um  ^Um  represents  actuator 
saturation,  i.e.,  cr(s)  =  [crfo)  cr2(s2)  •••  o-m(sm)]  with 
=  signfojminlljsil},  and  the  pair  {A,B)  is  stabiliz- 
able.  The  problem  of  global  asymptotic  stabilization  (in¬ 
ternal  stabilization)  of  this  system  has  recently  been 
solved  using  nonlinear  state  feedback  laws  and  under  the 
condition  that  all  the  eigenvalues  of  A  are  inside  or  on  the 
unit  circle  (Yang,  Sontag  &  Sussmann,  1997),  and 
for  neutrally  stable  open-loop  system  using  linear  state 
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feedback  (Choi,  1999).  Here,  we  are  interested  not  only  in 
closed-loop  state  space  stability  (internal  stability),  but 
also  in  stability  with  respect  to  both  measurement  and 
actuator  noises.  More  specifically,  we  would  like  to  con¬ 
struct  a  controller  #  so  that  the  operator  ( ulyu2 )h+ 
(y1}y2)  as  defined  by  the  following  standard  systems 
interconnection  (see  Fig.  1): 

JVi  =  +  y2\ 

y2  =  &(u2  +  TiX  (2) 

is  well  defined  and  finite  gain  stable. 

We  note  that  the  disturbance  ux  we  consider  here  is 
input  additive  and  enters  the  system  together  with  the 
control  input  u  through  the  actuators.  Simple  examples 
show  that  the  problem  we  consider  does  not  always  have 
a  solution  if  the  disturbance  enters  the  system  from 
outside  the  actuators. 

The  above  problem  was  first  studied  for  continuous¬ 
time  systems.  It  was  shown  in  Liu,  Chitour  and  Sontag 
(1996)  that,  for  neutrally  stable  open-loop  systems,  linear 
feedback  laws  can  be  used  to  achieve  finite  gain  stability, 
with  respect  to  every  Lp- norm.  For  a  neutrally  stable 
system,  all  open  loop  poles  are  located  in  the  closed 
left-half  plane,  with  those  on  the  jco-axis  having  Jordan 
blocks  of  size  one.  In  the  case  that  full  state  is  available 
for  feedback  (i.e.,  yx  =  x  and  u2  =  0),  it  was  shown  in  Lin, 
Saberi  and  Teel  (1995)  that  if  the  external  input  signal  is 
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Fig.  1.  Standard  closed-loop  connection. 


uniformly  bounded,  then  finite-gain  Lp-stabilization  and 
local  asymptotic  stabilization  can  always  be  achieved 
simultaneously  by  linear  feedback,  no  matter  where  the 
poles  of  the  open-loop  system  are.  The  uniform  bounded¬ 
ness  condition  of  Lin  et  al.  (1995)  was  later  removed  by 
resorting  to  nonlinear  feedback  (Lin,  1997).  Some  other 
works  related  to  the  topic  are  Hou,  Saberi  and  Lin 
(1997a),  Chitour,  Liu  and  Sontag  (1995),  Nguyen  and 
Jabbari  (1997),  Saberi,  Hou  and  Stoorvogel  (1998), 
Suarez,  Alvarez-Ramirez,  Sznaier  and  Ibarra-Valdez 
(1997)  and  the  references  therein. 

There  are  also  several  studies  in  the  discrete-time 
setting,  showing  some  of  the  continuous-time  results 
carry  over  to  discrete-time  (for  example,  Hou,  Saberi,  Lin 
&  Sannuti,  1997b;  Yang  et  al.,  1997)  and  some  do  not  (for 
example,  Hou  et  al.,  1997a,b).  In  particular,  Hou  et  al. 
(1997a, b)  show  that  the  results  of  Lin  (1997)  and  Lin  et  al. 
(1995)  on  finite  gain  stabilization  of  continuous-time  sys¬ 
tems  do  not  carry  over  to  discrete-time  systems.  The 
objective  of  this  paper  is  to  show  that  the  results  of  Liu  et 
al.  (1996),  however,  do  carry  over  to  discrete-time  sys¬ 
tems.  More  specifically,  we  show  that,  for  neutrally  stable 
discrete-time  linear  systems  subject  to  actuator  satura¬ 
tion,  finite  gain  lp  stabilization  can  be  achieved  by  linear 
output  feedback  for  all  pe(l,  oo].  An  explicit  construc¬ 
tion  of  the  corresponding  feedback  laws  is  given.  The 
feedback  laws  constructed  also  result  in  a  closed-loop 
system  that  is  globally  asymptotically  stable,  and  provide 
an  input-to-state  estimate.  While  many  of  the  arguments 
used  are  conceptually  similar  to  those  used  in  the  con¬ 
tinuous-time  case  Liu  et  al.  (1996),  there  are  technical 
aspects  that  are  very  different  and  not  totally  obvious. 
For  example,  unlike  in  Liu  et  al.  (1996),  the  feedback  gain 
for  the  discrete-time  case  needs  to  be  multiplied  by 
a  small  factor,  say  k,  which  causes  the  solution  of  a  cer¬ 
tain  Lyapunov  equation,  and  the  subsequent  estimation 
of  the  solution,  to  be  dependent  on  k  (see  Lemma  2).  As 
another  example,  the  difficulties  in  evaluating  the  differ¬ 
ence  of  the  non-quadratic  Lyapunov  function  along  the 
trajectories  of  the  closed-loop  system  entail  a  careful 
estimation  by  Taylor  expansion. 

The  remainder  of  the  paper  is  organized  as  follows. 
Section  2  states  the  main  results.  Section  3  contains  the 
proof  of  the  results  that  were  stated  in  Section  2.  A  brief 
concluding  remark  is  given  in  Section  4. 


2.  Preliminary  and  problem  statement 

We  first  recall  some  notation.  For  a  vector  X  e  1R',  \X\ 
denotes  the  Euclidean  norm  of  X ,  and  for  a  matrix 
X  e  Um  x  ”,  the  induced  operator  norm.  For  any  p  e  [1,  oo ), 
we  write  /”  for  the  set  of  all  sequences  {x(t)}?L0,  where 
xeUn ,  such  that  0\x(t)\p  c  oo,  and  the  /p-norm  of 
xelnp  is  defined  as  ||x||/jt  =  (]££  oM*)r)1/p*  We  use  to 
denote  the  set  of  all  sequences  {x(t)}r®  0,  where  xeR”, 
such  that  sup,  \x(t)\  <  oo,  and  the  norm  of  xe/^  is 
defined  as  \\x\\lm  =  sup,  \x(t)\. 

The  objective  of  this  paper  is  to  show  the  following 
result  concerning  the  global  asymptotic  stabilization  as 
well  as  lp -stabilization  of  system  as  given  by  (1),  using 
linear  output  feedback. 


Theorem  1,  Consider  a  system  (1).  Let  A  be  neutrally 
stable ,  i.e.y  all  the  eigenvalues  of  A  are  inside  or  on  the  unit 
circle ,  with  those  on  the  unit  circle  having  all  Jordan  blocks 
of  size  one .  Also  assume  that  {A,  B)  is  stabilizable  and  ( A ,  C) 
is  detectable.  Then ,  there  exits  a  linear  observer-based 
output  feedback  law  of  the  form 

x+  =  Ax  +■  Bo(Fx)  —  L(y  —  Cx), 


u  —  Fx 


(3) 


which  has  the  following  properties : 

1.  It  is  finite  gain  lp-stable  for  all  pe(l,  oo],  i.e.,  there 
exists  a  yp  >  0  such  that 

IMli,  <yP[||willi,  +  ||u2||/„],  Vui  e/p,  u2  elrp 

and  x(0)  =  0,  x(0)  =  0.  (4) 

2.  In  the  absence  of  actuator  and  sensor  noises  ux  and  u2, 
the  equilibrium  (x,x)  =  (0,0)  is  globally  asymptotically 
stable. 


Remark  1.  We  will  in  fact  actually  obtain  the  following 
stronger  ISS-like  property  (see  Sontag,  1998  and  refer¬ 
ences  there  in): 

ll(x,*)lh,  <  ep(\x(0)\  +  |x(0)|)  +  y,[| \ux\\h  +  ||u2|ia  (5) 

where  8P  is  a  class-^T  function.  Observe  that  the  single 
estimate  (5)  encompasses  both  the  gain  estimate  (4)  and 
asymptotic  stability.  Obviously,  (4)  is  the  special  case  of 
(5)  for  zero  initial  states.  On  the  other  hand,  when  applied 
with  arbitrary  initial  states  but  ux  —u2  =0,  there  follows 
that  (x,x)  is  in  lpi  which  implies,  in  particular,  that 
(x(t),x(t))  must  converge  to  zero  as  t  ->  oo  (global  attrac¬ 
tion)  and  that  |(x(t),  x(t))|  is  bounded  by  0p(|x(O)|  -1-  |x(0)|) 
(stability). 
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3.  Proof  of  Theorem  1 

The  proof  of  Theorem  1  will  follow  readily  from  the 
following  proposition,  which  we  establish  first. 

Proposition  1.  Let  A  be  orthogonal  {i.e.,  A' A  —  I), an  d 
suppose  that  the  pair  (A,  B)  is  controllable.  Then, the  system 

x+  =  Ax  +  Ba(  -  kB'Ax  +  u),  xeM",  ueOT  (6) 

is  finite  gain  lp-stable,  pe(l,  oo],  for  sufficiently  small 
k  >  0.  Moreover,  for  each  pe(l,  oo]  there  exist  a  real  yp, 
a  k*  e(0, 1],  and  a  class- function  6p  such  that,  for  all 
jce(0,jc*], 

IMIi,  <  VpIMli,  +  0p(M°)D  (7) 

for  all  inputs  uelp  and  all  initial  states  x(0). 

To  prove  this  proposition,  we  need  to  establish  a  few 
lemmas. 

Lemma  1.  For  any  p  >  l  >  0,  there  exist  two  scalars 
MuM2  >  0  such  that,  for  any  two  positive  scalars  £  and  (, 

<M1£P+  M2(p  (8) 

and  consequently,  for  any  n  >  0  and  k  >  0, 

£p-'£'  <  MjkV  +  Kffi-p)'lM2Zp.  (9) 

Proof  of  Lemma  1.  Let  h:U+  be  defined  as 

h{x)  =  x1/ip~l),  which  is  continuous  and  strictly  increasing 
with  h{ 0)  =  0  and  h{  oo )  =  oo ,  and  k(x)  =  x(p~m  be  its 
pointwise  inverse.  Define 

H{x)  =  U)do  =  ^x--'>  (10) 

Jo  P 

and 

K{x)  =  f  k(v)  dv  =  -xp,!.  (11) 

Jo  P 

Letting  a  =  £p~‘  and  b  =  C,  it  follows  from  Young’s 
inequality  (Hardy,  Littlewood  &  Polya,  1952), 
ab  <  H{a)  +  K(b)  for  all  a,  b  e  U +,  that 

^-^<PzJ^  +  iCr  =  Ml^  +  M2Cp,  (12) 

P  P 

which  also  trivially  implies  (9).  □ 

Lemma  2.  Let  A  and  B  be  as  given  in_. Proposition  1.  Then, 
for  any  k  >  0  such  that  kB'B  <  21,  A(k)  =  A  —  kBB'A  is 
asymptotically  stable.  Moreover,  let  P(k)  be  the  unique 
)  positive-definite  solution  to  the  Lyapunov  equation, 

(13) 


Then,  there  exists  a  k*  >  0  such  that 
—  I<  P(k)  <  —I,  Vk6(0,  k*]  (14) 

K  K 

for  some  positive  constants  Xi  and  X2  independent  of  K. 

Proof  of  Lemma  2.  The  asymptotic  stability  of  A  follows 
from  a  simple  Lyapunov/LaSalle  argument  (Choi,  1999). 
Let  k*  >  0  be  such  that  kB'B  <  21  for  all  k  e  (0,  kJ].  We 
recall  that  the  solution  to  the  Lyapunov  equation  (13)  is 
given  by 

P(K)  =  £  (A\K))'Ak(K) 

k—  O 

=  £  1{A  -  kBB’A)'TI(A  -  kBB'A)T.  (15) 

k  —  0 

Using  the  fact  that  AA'  =  I,  we  have 

( A  -  kBB’A)' (A  -  kBB'A) 

=  1-  IkA'BB'A  +  k2A'BB'BB'A 

=  /  -  kA'B(2I  -  kB’B)B’A.  (16) 

Using  now  the  fact  that  kB'B  <21  for  kg(0,kJ].  we 
know  that  there  exists  xrf  e  (0,  xf ]  such  that 

il  <  (A  -  kBB'A)'{A  -  kBB'A)  <  I,  Vk  e  (0,  kJ].  (17) 

Again  using  the  fact  that  A' A  =  I,  we  verify  in  a  straight¬ 
forward  way  that 

(. A  -  kBB'A)"  =  A"  -  kCa,  b  Cf  BA"  +  k2Ml  (k),  (1 8) 

where  Mj(/c)  is  a  polynomial  matrix  in  k  of  order  n  —  2, 
n  being  the  order  of  the  system  (6),  and 

CA'B  =  IB  AB  -  A"~lB-\ 

is  the  controllability  matrix  of  the  pair  ( A ,  B)  and  is  of  full 
rank.  It  then  follows  that 

((A-kBB'A)")'(A-kBB'A)" 

=  P")'  -  k(A")'Ca,bC'a_b  +  k2M\(k)) 

(A"  -  kCa,bC'a.bA"  +  K2MfK)) 

=  I  -  2k(A")'Ca,bC'a,  bA"  +  k2M2(k),  (19) 

where  M2(k)  is  a  symmetric  polynomial  matrix  in  k  of 
order  2 n  —  2.  Since  CAiB  is  of  full  rank,  and  because  A  is 
nonsingular,  there  exists  a  K*e(0,fcj]  such  that 

0  <  /  -  kM°J  <  ((A  -  kBB’AY)’(A  -  kBB’A f 

<  I  —  kM°  I  <  I,  Vk  e  (0,  k*]  (20) 

for  some  constants  M?,M°  >  0  independent  of  k. 


A(k)'PA(k)  -  P  =  —  I. 
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Using  (17),  (20)  and  the  fact  that  A' A  =  1  in  (15),  we 
have  that  for  all  jce(0,K*], 


n-l 


P(k)<  £  [[A  —  kBB'A)‘J(A  —  kBB’A)'  £  (1  -  KM°2)kI 

1=0  k= 0 


,  1  ,  hr 

<n— qJ  =  — / 

kM2  k 


(21) 


and 


P(k)  ;>  ”£  [(A  -  kBB'A)‘J(A  -  kBB'A)‘  £  (1  -  kM\)H 

i-0  k-0 


where  X\  —  n/2"  1M°  and  Xi  =  n/M° ■  □ 


Lemma  3.  Let  A(k)  be  as  given  in  Proposition  1,  P(k)  as 
defined  in  Lemma  2,  then  for  any  pe(l,  oo),  there  exists 
a  k*  >  0  such  that 

[x,I'(k)P(k)1(k)x]',/2  -  [x'P(k)x]p/2 

<  -K(2-p),2t\x\P,  K£(0,K*l  (23) 

where  £  >  0  is  some  constant  independent  of  k. 


Proof  of  Lemma  3.  Inequality  (23)  holds  trivially  for 
x  =  0.  Hence,  in  what  follows,  we  assume,  without  loss  of 
generality,  that  x  #  0. 

For  simplicity,  we  introduce  from  now  the  following 
notation: 


p  =  x'A'(k)P(k)A(k)x  .  (24) 

(where  x  and  k  will  be  clear  from  the  context).  By  the 
definition  of  P{k),  we  have 

p  —  x'P(k)x  =  —  x'x.  (25) 

From  Lemma  2,  there  exists  a  icf  >  0  such  that  for  all 
JC6(0,Kj] 


x'x  ^  4 
x'P(k)x  “5’ 


Vx  0. 


(26) 


With  (25)  and  (26),  we  can  continue  the  proof  using 
Taylor  expansion  with  remainder. 


Ix'A'(k)P(k)/L{k)xY12  -  [x'P(x)x]p/2 
=  [x'P(k)x  -  x'x]p/2  -  [x'P(k)x]p/2 


<  [x'P(k)x]p/2|^1  - 
-  [x'P(k)x]p/2 


p  x'x  J  x'x  \ 2 
2  x'P(k)x  +  \x'P(k)x) 


=  -|[x'P(K)x](p-2)/2|x|2  +  <5[x'P(jc)x](p  ~  4)/2|  x|4, 

(27) 


where  5  =  max|z|s4/5{f|(p  —  2)(1  +  z)p/2_2|}  is  a  constant 
independent  of  k. 

Again  by  Lemma  2,  there  exists  a  k*  e(0,Kt]  such  that 
[p]p/1  -  [x'P(k)x]p/2  <  -  K(2_p)/2C|x|p  kg(0,k*]  (28) 

for  some  £  >  0  independent  of  k.  □ 


Lemma  4.  Let  A  and  B  be  as  given  in  Proposition  1.  For 
any  l  e  [1,  oo )  and  any  k  e  (0, 1], 

M  -  kB'Ax  +  u)|'  <  2,_1k1|J3|!|x|i  +  2r~1|w|I.  (29) 


Proof  of  Lemma  4.  Since  a  is  a  standard  saturation 
function  and  \A\  =  1,  for  any  J  >  1,  we  have 

|<r(  -  kB'Ax  +  u)|'  <  (k|B||x|  +  |u|)' 

<2'"1k'|B|!W'  +  2'_,|u|',  (30) 

where  the  last  inequality  follows  from  Jensen’s  inequality 
applied  to  the  convex  function  sl : 

(a  +  by  <  i(2 a)1  +  {{2b)1,  Va,  b  >  0.  □ 


Lemma  5.  Let  A  and  B  be  as  given  in  Proposition  1.  Pick 
any  x  e  R"  and  u  e  Rm,  any  number  t]  >  3,  and  any  non¬ 
negative  real  number  l.  Denote  x  —  —  kB'Ax  +  u.  Then, 
provided  |x|  >  t]\Bo{x)\,  we  have 

| Ax  +  B<r(x) |'  <  |x|'  +  l\x\l~2x'A'Bo(x) 

+  M|x|,-2|B<r(x)|2  (31) 

for  some  constant  M  >  0  which  is  independent  of  k. 


Proof  of  Lemma  5.  We  first  note  that,  since 
|x|  >  rj\B(i(x)\  >  3|Bff(x)|, 

\2x'A'Ba{x)  +  |Bff(x)|2|  4 


|x|2 


—  5 


(32) 


Hence,  using  Taylor  expansion  with  remainder,  we  have 
|  Ax  +  Bo-(x)  |'  =  [|x|2  +  2  x’A'Bc(x)  +  |B<r(x)|2],/2 
2x'A’Bo(x)  +  |Bu(x)|2^  1/2 


=  M'( 


|x|2 


,  ,  l  2 x'ABoix)  +  |B<r(x)|2 
2  |x|2 


+  5\ 


2  x'A'Bo{x)  +  |B<r(x)| 

FT 


S\|2\  2 


)] 


<  |x|'  +  l\x\l-2x'A'Bo{x)  +  ||x|'- 2|Bcr(x)|2 

+  <5|x|,-4((2  +  \/n)\x\\Ba{x)\)2,  (33) 

where  5  =  maX|Zj^4/5  {i/|(l  —  2)(1  +  z),/2  2|}  is  a  constant 
independent  of  k. 


jce(0,jcf], 
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So  we  can  see  that  the  inequality  (31)  holds  for 
M  =  j  +  5(2  +  lyty)2*  d 

We  are  now  ready  to  prove  Proposition  1. 

Proof  of  Proposition  1.  We  separate  the  proof  for 
pe(l,  oo)  and  for  p  =  oo. 

Proof  for  pe(  1,  oo):  For  clarity,  let  us  repeat  here  the 
system  equation  (6) 

x +  =  Ax  +  B<j(  —  kB'Ax  +  u),  x  e  R",  u  e  Um.  (34) 

This  may  also  be  rewritten  as 

x*  =  A(k)x  +  B(  -  x  +  <r(x)  +  u),  xe u e Rm,  (35) 

where  A(k)  =  A  —  kBB'A ,  x  =  —  kB'Ax  -f  u. 

For  this  system,  define  the  function  Fi  as 

Fi(x)  =  (xT(k)x)p/2,  (36) 

where  P(k)  is  as  given  in  Lemma  2.  We  next  evaluate  the 
increments  F(x+(f))  —  V(x(t)),  which  we  denote  as  “AVf’ 
for  short,  along  any  given  trajectory  of  (35).  It  is  conve¬ 
nient  to  treat  separately  the  cases  |x|  >  tj\Bo(x)\  and 
|x|  <  rj\Ba(x)\,  Here  tj  ^  3  is  a  number  to  be  specified 
soon. 

Case  1:  |x|  >  r/\Bc{x)\.  Using  the  definition  of  Vu  we 
now  give  an  upper  bound  on  AVX  along  the  trajectories 
of  the  system  (35).  To  simplify  the  equations,  we  intro¬ 
duce  the  following  notation: 

v  =  2xx'A’P(K)BBfAx  +  2x'A'P(k)Bo(x) 

+  a'(x)B'P(fc)Ba(x), 

in  addition  to  /x  as  defined  in  Eq.  (24).  Thus, 

AV,  =  Vt  -  V i 

=  [(x+)'P(k)x+]p/2  -  [x'P(k)x]p/2 
=  [D4(k)x  +  kBB'Ax  +  B<t(x)JP{k)[A(k)x 
+  kBB'Ax  +  Ba(x)J]plz  -  [x'P(k)x]p/2 
=  in  +  2x'A'P(k)B(kB'Ax  +  a(x)) 

-  k2x'A'BB'P(k)BB'Ax  +  c'(x)B'P{K)Ba(x)Y12 

-  [x'P(k)x]p/2 
<:[/*+ v]p/2-[x'P(k)x]p/2 

r  vip/2 

=  MW2  i  +  JJ  (37) 

By  Lemma  2,  there  exist  a  kJ  >  0  and  rj  >  3  independent 
of  k,  such  that  for  all  |x|  >  ?7|Bcr(x)| 

-  <1  >ce(0,Kg]. 

5 


To  see  this,  let  Kg  >  0  be  such  that  (14)  of  Lemma  2  and 
(17)  in  the  proof  of  Lemma  2  both  hold  for  all  k e(0,  Kg]. 
Then,  for  all  k  g  (0,  Kg],  we  have 

MS[W  +  |)+;^]M2  (39) 

and 

N>||x|2,  (40) 

from  which  it  is  clear  that  there  exist  Kg  and  r\>  3  such 
that  (38)  holds. 

Next,  we  may  use  a  Taylor  expansion  with  remainder 
to  continue  the  bounding  of  AF]  as  follows: 

AF,  <Mp/2^l+|^  +  <5  m  -  [x'P(k)x]p/2,  (41) 

where  5  =  maxWs4/5{ip|(p  -  2)(1  +  z)p/2-2|}  is  a  con¬ 
stant  independent  of  k. 

By  Lemmas  3  and  2,  there  exists  Kg  g(0,k*]  such  that 
for  any  kg(0,  Kg],  we  have 

AFj  <  -K,2-p>/2C|x|p  +  ^[/i](p-2)/2[v]  +  <5M(p"4)/2[v]2 

<  _  K(2“p>/2f|x|p  +  i/(1k<2~p)/2|x|p~2 

x  [2|x||P(k)B||x  -  <r(x)|  +  2|x||P(k)B||«| 

+  |P(k)||B<j(x)|2]  +  <A2K(4-p)/2|x|p"4 

x  [2|x|2|kP(k)||J3|2  +  2|P(k)||x||B<7(x))| 

+  |P(k)||B<x(x)|2]2,  (42) 

where  (  >  0  is  as  defined  in  Lemma  3,  and  i/'j  ,  i//2  >  0  are 
some  constants  independent  of  k. 

Before  continuing,  we  digress  to  observe  that 

|x  —  cr(x)|  <  x'cr(x).  (43) 

Using  (43),  Lemmas  1  and  4,  and  the  condition 
|x|  >  jj|B<t(x)|,  we  can  show  that  there  exists  a  Kg  g  (0,  Kg] 
such  that  for  all  k g  (0,  Kg]  the  estimation  of  AF]  can  be 
now  concluded  as  follows: 

AFj  <  -K(2"p)/2C|x|p  +  2lAiK(2-p)/2|x|p-1|P(K)B|x'ff(x) 

+  M1ok<2  _p)/2max{K,  kp_  1}|x|p + M2„(k)\u\p, 

(44) 

where  Mla  >  0,  M2o(k)  >  0  with  Mla  independent  of 
k  are  defined  in  an  obvious  way.  In  deriving  (44),  we  have 
also  used  the  fact  that  |x|p-2  <  (\Bcr(x)\/tiY~2  for  p  <  2 
and  Ba(x)  #  0. 


(38) 
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Case  2:  |x|  <  rj\Ba(x)\.  By  using  Lemmas  2-4,  AFX 
along  the  trajectories  of  (35)  is  bounded  as  follows: 


Case  2:  |x|  >  rj\Bcr(x)\.  By  Lemmas  5,  4  and  1,  there 
exists  k*  e  (0,  k*]  such  that  for  any  k  e  (0,  k|], 


AFj  =  [(x+)'P(/c)x+]p/2  -  [x'P(k)x]p/2 

<  \P(k)\p/2\Ax  +  Be t(x)|p  -  [x'P(k)x]p/2  +  [>]p/2 

<  _  Ka-r)/^|x|r  +  k~pI2xP2I2(\x\  +  |B<t(x)|)p 

<  -  k(2~p)/2Qx\p  +  {r]  +  iyK-pl2xP2,2\Ba(xW 

<  _  Kv-M2t\x\>  +  MlbK-(p~2)l2Kp-l\x\p 

+  M2t(K)|u|p  Ke(0,K|],  (45) 

where  Xi  >  0  and  C  >  0  are  as  defined  in  Lemmas  2  and 
3,  respectively,  and  Mlb>  0,  M2(,(k)  >  0  are  constants 
with  Mlb  being  independent  of  k. 

Summarizing,  we  may  combine  Case  1  with  Case  2,  to 
obtain 

AFj  < 

-/Kl2-p),2Qx\p  +  2i]/iKi2~p)l2  \P(K)B\\x\p-1x'a(x) 

I  +  Mi  k(2 -p)/2max{K,  kp~ *}  |x|p 
<  +  M2(k)\u\p,  if  |x|  >  t]\Ba(x)\, 

-J  K(2-p)/2C|x|p  +  M^2-p)'2  kp_  1|x|p  +  M2(k)\u\p 
yif  |x|  <  (46) 

where 

Mi  =  max{M  ia,  M  u} 
and 

M2(k)  =  max{M2o(K),M2I,(K)}. 

For  system  (34),  we  next  define  another  function 

Fo(x)  =  Mp+1.  (47) 

An  estimation  of  its  increments  along  the  trajectories  of 
(34)  can  also  be  carried  out  by  separately  considering 
each  of  the  cases  |x|  >  rj\Bo{x)\  and  |x|  <  t]\Ba(x)\. 

Case  1:  |x|  <  rj\Bcr{x)\.  By  Lemma  4,  for  any  k  e  (0,  ;cf], 

AF0  =  | Ax  +  P<7(x)|p+1  -  |x|p+1  <  | Ax  +  Ba(x) |p  +  1 

<  (|x|  +  |Pcr(x)|)p+1  <  (fa  +  l)|Po-(x)|)p+1 

<  kA1o|x|p  +  N2„|«|p  (48) 

for  some  positive  constants  Nla  and  N2a  independent 
of  k.  In  deriving  (48),  we  have  used  the  fact  that  both 
c  and  k  are  bounded. 


AF0  =  | Ax  +  J3<r(x)|p+1  -  |x|p+1, 

<  |x|p+ 1  +  (p  +  l)|x|p-1x'A'Bcr(x) 

+  7711,|Bo’(x)|2|x|p_1  —  |x|p+1, 

<  —  ^-^|x|p~1xT<r(x)  +  k7V1c|x|p  +  JV2c(k)|m|p, 

(49) 

where  Nlc,Nlh  >  0,  N2c(k)  >  0  are  constants,  and 
Nxb,Nlc  are  independent  of  k.  In  deriving  (49),  the  first 
inequality  by  Lemma  5,  the  second  inequality  is  the  con¬ 
sequence  of  the  fact  that  o  is  bounded  and  Lemmas  4 
and  1. 

Combining  Case  1  with  Case  2,  we  have,  for  any 
ke(0,k:|], 

C-^\x\p-2~x'c{x) 

AF0  <  +  zcAT1|x|p  +  N2(/c)|u|p,  if  |x|  >  n\Ba{x)\, 

jcA1|x|p  +  iV2(K)|u|p,  if  |x|  <  V\Bo(x)\, 

(50) 

where 

Ni  =  ma  x{Nla,Nlc} 
and 

N2(k)  =  max{N2fl,  N2c(k)}. 

Finally,  we  define  the  following  Lyapunov  (or  “storage”) 
function: 

F(x)  =  Fi  (x)  +  mV  o  (x),  (51) 

where 

a  =  -^-jK«-p»2il,i\P(K)B\. 

It  is  straightforward  to  verify  that  there  exists  some 
k*g(0,kJ]  such  that 

AV{x)  <  -  Ki2'p)/2a\x\p  +  P(k)\u\p,  V7ce(0,K*]  (52) 

for  some  ae  (0, 0  and  P(k)  >  0. 

Now  consider  an  arbitrary  initial  state  x(0)  and  control 
w,  and  the  ensuing  trajectory  x.  Summing  both  sides  of 
(52)  from  £  =  0  to  oo  and  using  the  fact  that  V  is  non¬ 
negative,  we  conclude  that 

K(2-p>/2a||x||j»  <  +  ^o(|x(0)|),  (53) 

where  9p0 (r)  =  m rp+1  +  {Xir2 lK)Pl2-  This  implies  that 
IMb,  <yPNk  +ep(|x(0)|),  (54) 

where 

1P  =  (Ktp~2)l2P(K)/a)Up, 
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and 

e„(r)  =  (K{p-2),20Po{r)/«)1,p. 

Proof  for  p  —  oo .  From  (52)  we  get  for  p  =  2, 

AF(x)  <  -  a|x|2  +  j8(K)||«||?.  .  (55) 

Hence,  AF(x)  is  negative  outside  the  ball  of  radius 
(/J(K)/a)1/2||u||j_  centered  at  the  origin,  from  which  it  fol¬ 
lows  that,  for  any  state  x(r)  in  the  trajectory: 

+  0»o(|x(O)|),  (56) 

where  0roO(r)  =  (liMr2  +  m3.  If  ||u||,_  <  1,  we  have 


— |x(t)|2  <  x(t)'P(K)x(t)  <  V(x{t)) 
K 


(57) 


and 

W))< 


^3/2M  ,  Xi P(k)  \u..,a 


~3/2 


a  k 


*) 


Ml?.  +  0„o(|x(O)|)  (58) 


which  implies  the  following  estimate  for  the  entire  traject¬ 
ory: 


Mi. 


Kmp3,2(K)  |  XiP(k)\  1/2 
!Xi  «Xi  J 


fjcnr/J3' 


\\u\\u  +eKl(m\), 


(59) 


where  6ml(r)  =  (K0«o(r)/Xi)1/2-  If,  instead,  ||u|[,_  >  1,  we 
have 


et|x|3  <  F(x)  < 


&P3,2{k)  Xt.P(k) 


„3/2 


a"'*  ock 

+  eml(\xm 

from  which  we  get  that 


!)ih.3 


(60) 


llxlb.  <  l/3||«ll/„  +  0»2(|x(O)|),  (61) 

f  m  kol m  ) 

where  0ro2(r)  =  (0coo(r)/w)1/3-  Letting 


yro  =  max 


kw$3,\k)  +  x20(k)1  ’ 


a3/2Xr 


«Xi 


r 


a  mK  J 


a3/2cj 


and  =  max{0tol,0oo2},  we  have,  finally,  the  required 
conclusion: 


Proof  of  Theorem  1.  Without  loss  of  generality,  making 
a  change  of  coordinates  if  required,  we  may  assume  that 
the  system  (1)  has  the  following  partitioned  form: 

Xi  =  AxXi  +  J3x(7(u  +  Ui), 

Xq  =A0x0  +  B0o(u  +  iq),  (63) 

y  =  Cx  +  u2. 

where  A2  is  orthogonal  and  A0  is  asymptotically  stable, 
and 


r*  0 1. 

B=rs‘i. 

1 — 
o 

o 
1— . 

UoJ 

We  construct  the  output  feedback  law  in  the  form  of  (3) 
with  F  =  [  —  kB\  Ai  0],  the  matrix  L  being  chosen  such 
that  A  +  LC  is  asymptotically  stable.  Using  this  feed¬ 
back,  the  closed-loop  system  is 

(t  =  Axx2  +  Fi cr(  -  kB'xAiXx  +  Uj), 
ico  =  ^4oxo  +  B0cr(  -  kB'iAiXx  +  iq),  (64) 

£+  =  Ax  +  Bo(  -  Kfi'^iXi)  -  L(Cx  -  Cx  +  u2). 

Let  e  =  [e\  e'0]',  where  e2  -  x2  —  x2  and  e0  =  x0  —  x0. 
Here  we  have  partitioned  x  =  [x\  x'0]'  accordingly.  In 
the  new  states  (x,  e),  (64)  can  be  written  as  follows, 

xt  =  AtXx  +  Bi<r{  —  kB’iAiXi  +  kB^A^!  +  tq), 

x£  =  A0x0  +  B0o{  -  kB\AiXi  +  kB'iA^i  +  ux), 

e+  =  ( A  +  LC)e 

+  B[a(  —  kB'iAiX j  4-  KB\Aie1  +  «i) 

—  <r(  —  kB’i^4jXi  +  KB'iAieiJ]  +  Lu2.  (65) 
Since  o  is  global  Lipschitz  with  a  Lipschitz  constant  1, 
|cr(  —  kB\AiXi  +  KB'iAiei  +  Uj) 

-  a(  —  KB’iAiXi  +  KB'lA1e1)\  <  |«||.  (66) 

Noting  that  A  +  LC  is  asymptotically  stable  and  viewing 
cr(  —  kB'  1A1X1  +  kB'  1A1S1  +  Ui) 

—  ct(  —  kB\AiXi  +  KB\Aiei)  +  Lu2 

as  an  lp  input  to  the  e-subsystem,  we  have  that,  for  some 
constant  ype  >  0, 

IMIi,  <  VP£(I|miIIi,  +  ll«2lli,  +  |e(0)[).  (67) 

Next,  applying  Proposition  1  to  the  x1  -subsystem,  and 
viewing  kB'  *  A ^  +  ux  as  an  lp  input  to  this  subsystem, 
we  have, 

M,  <rpi(ll«illi,  + 11^2  Hi,  +  le(0)l)  +  MM0)l) 

for  some  ypX  >  0  and  0piof  class  JT. 


lIxlL  <?colNl!„  +0co(WO)|) 
for  p  =  oo  as  well. 

We  are  now  ready  to  prove  Theorem  1.  □ 


(62) 
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On  the  other  hand,  viewing  o(  —  kB\A1x,+ 
KB'iA1e1  +  ux)  as  an  lp  input  to  the  x0-subsystem,  we 
have  the  estimate 

ll*olk  ^  MMilIx,  +  M\i,  +  IlMlIli,  +  l^o (0)1) 

for  some  yp0  >  0. 

In  conclusion,  we  have 

Mix,  <M  II,,  +  IMz, 

<  yP(M,  +  \\u2\\lp)  +  cpp(m\  +  WP)|),  (68) 

where  yp  >  0  is  some  constant  and  <pp  is  a  suitable 
class-X  function.  Together  with  (67),  and  changing  back 
to  the  original  coordinates,  we  also  conclude  that  an 
estimate  like  the  one  in  (5)  holds.  □ 


4.  Conclusions 

In  this  paper,  we  have  established  that  a  discrete-time, 
neutrally  stable,  stabilizable,  and  detectable  linear  sys¬ 
tem,  when  subject  to  actuator  saturation,  is  finite  gain 
lp  stabilizable  by  linear  feedback,  for  any  pe(l,oo]. 
A  linear  output  feedback  law  which  simultaneously 
achieves  lp  stabilization  and  global  asymptotic  stabiliz¬ 
ation  was  constructed. 
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SUMMARY 

A  low-gain  design  for  linear  discrete-time  systems  subject  to  input  saturation  was  recently  developed  to  solve 
both  semi-global  stabilization  and  semi-global  output  regulation  problems.  This  paper  proposes  an 
improvement  to  the  low-gain  design  and  determines  controllers  with  the  new  design  that  achieve  semi-global 
output  regulation.  The  improvement  is  reflected  in  better  utilization  of  available  control  capacity  and 
consequently  better  closed-loop  performance.  Copyright  ©  2000  John  Wiley  &  Sons,  Ltd. 

KEY  WORDS:  actuator  saturation;  input  saturation;  output  regulation;  low-gain  feedback 


1.  INTRODUCTION 

Recently,  there  has  been  a  surge  of  interest  in  the  study  of  linear  systems  subject  to  input 
saturation  due  to  a  wide  recognition  of  the  inherent  constraints  on  the  control  actuator.  Although 
most  of  the  results  in  this  study  pertain  to  the  problem  of  global  stabilization  (see,  for  example, 
References  [1-5])  and  semi-global  stabilization  (see,  for  example,  Reference  [6-12]),  some 
attempts  have  also  been  made  in  the  solution  of  output  regulation  problems  for  continuous-time 
systems.  Roughly  speaking,  this  problem  is  one  of  controlling  a  linear  system  subject  to  input 
saturation  in  order  to  have  its  output  track  (or  reject)  a  family  of  reference  (or  disturbance)  signals 
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generated  by  some  external  system,  usually  called  the  exosystem.  The  control  laws  that  solve  the 
output  regulation  problems  are  referred  to  as  regulators.  A  global  output  regulation  problem 
results  if  tracking  and  disturbance  rejection  is  required  to  occur  for  all  initial  conditions  of  the 
closed-loop  system,  while  a  semi-global  output  regulation  problem  results  if  tracking  and 
disturbance  rejection  is  only  required  to  occur  when  the  initial  conditions  of  the  closed-loop 
system  are  inside  an  a  priori  given  (arbitrarily  large)  bounded  set  of  the  state  space.  The  global 
output  regulation  problem  and  semi-global  output  regulation  problem  for  linear  continuous-time 
systems  subject  to  input  saturation  were  recently  studied  in  References  [13- 15].  More  recently, 
for  the  discrete-time  systems,  the  semi-global  output  regulation  problem  was  also  studied  in  detail 
in  Reference  [16].  As  was  concluded  for  both  the  continuous-time  case  [15]  and  the  discrete¬ 
time  case  [16],  although  the  global  output  regulation  is  appealing  by  definition,  the  semi- 
global  output  regulation  is  achievable  for  a  much  larger  class  of  systems  and  allows  for  linear 
feedbacks 

This  paper  represents  a  continued  effort  of  [16]  on  the  study  of  semi-global  output  regulation 
problem  for  linear  discrete-time  systems  subject  to  input  saturation.  In  Reference  [16]  a  set  of 
solvability  conditions  are  given  and  linear  feedback  laws  which  solve  the  semi-global  output 
regulation  problem  are  constructed.  These  feedback  laws  are  constructed  in  such  a  way  that  for 
any  a  priori  given  bounded  set  of  initial  conditions  the  control  signals  will  not  saturate  after 
a  finite  time,  which,  for  large  sets  of  initial  conditions,  entails  very  low  feedback  gains.  As  a  result, 
because  of  linearity,  whenever  the  state  is  close  to  the  origin,  the  control  input  will  be  far  away 
from  its  maximum  allowable  value  and  thus  the  closed-loop  system  will  be  operating  far  from  its 
full  capacity.  To  avoid  such  a  situation  from  happening,  in  this  paper,  we  construct  new  feedback 
laws,  which  also  solve  the  semi-global  output  regulation  problems  under  the  same  solvability 
conditions.  These  new  feedback  laws  are  constructed  based  on  a  new  design  technique  to  be 
developed  in  the  paper.  The  new  design  reflects  fuller  utilization  of  the  available  control  capacity 
and  consequently  better  closed-loop  performance.  We  should  point  out  that  the  fundamental 
significance  of  the  new  design  technique  introduced  here  is  due  to  the  fact  that  it  is  of  a  semi- 
global  nature.  A  design  conceptually  similar  to  ours  was  introduced  in  the  interesting  paper  [17] 
for  local  stabilization. 

The  remainder  of  this  paper  is  organized  as  follows.  In  Section  2  we  recall  the  problem 
formulation  and  the  solvability  conditions  from  [16].  The  new  design  for  state  feedback  output 
regulators  is  given  in  Section  3,  while  its  error  feedback  counterpart  is  given  in  Section  4.  In 
Section  5,  we  show  that  the  generalized  semi-global  output  regulation  problems  we  formulated  in 
References  [15, 16],  which  allow  an  external  driving  signal  to  the  exosystem,  can  also  be  solved  by 
regulators  based  on  the  new  design.  Finally,  we  draw  a  brief  conclusion  in  Section  6. 

We  will  mostly  use  standard  notation  in  this  paper.  However,  we  have  denoted  the  shift 
operator  by  a  superscript +,  i.e.  x+(k)  =  x(k  +  1).  Moreover,  for  notational  brevity,  we  will 
suppress  the  time  index  k.  For  a  vector  q  =  [qi,  qi,  ... ,  #n]’  we  define 

IgU  =  max  |  <j;  | 

i 

On  the  other  hand,  for  a  vector-valued  function  w  and  X  ^  0  we  define 
MU  =  sup  |w(fc)U  MU.k  =  sup|w(/c)U 

k  k>K 

Finally,  ||-||  denotes  the  standard  Euclidean  norm. 
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2.  PRELIMINARIES  AND  PROBLEM  STATEMENT 

We  consider  the  output  regulation  problems  when  the  plant  inputs  are  subject  to  saturation. 
More  specifically,  we  consider  a  multivariable  system  with  inputs  that  are  subject  to  saturation 
together  with  an  exosystem  that  generates  disturbance  and  reference  signals  as  described  by  the 
following  system: 

x+  =  Ax  +  Bcr(w)  +  Pw 

w+  =  Sw  (1) 


e  —  Cx  +  Qw 

where  x  e  R",  w  6  R1,  u  e  Km,  e  e  IRP,  and  a  is  a  vector-valued  saturation  function  defined  as 

o(s)  =  [ffi(si),  <r2(s2),  ••• .  ffm(Sm)]'  (2) 


with 


f  Si  if  |s,|  <  1 

ff;(si)  =  |  —1  if  s,-  <  —  1  (3) 

(  1  if  S;  >  1 

Also,  without  loss  of  generality,  we  assume  that  matrix  B  is  of  full  rank. 

Remark 

Unlike  in  the  semi-global  stabilization  problem  (see  e.g.  [15]),  each  component  of  the  satura¬ 
tion  function  a  in  the  semi-global  output  regulation  problem  needs  to  be  exactly  known  at 
a  neighbourhood  of  the  origin  for  possible  disturbance  rejection.  Without  loss  of  generality,  we 
have  assumed  that  this  neighbourhood  has  a  radius  of  1  and,  to  ensure  the  existence  of  linear 
feedback  regulators,  we  have  also  assumed  that  at  is  linear  in  this  neighbourhood. 

Following  [18]  for  linear  systems  in  the  absence  of  input  saturation,  the  semi-global  linear 
feedback  output  regulation  problem  and  semi-global  linear  observer-based  error  feedback  output 
regulation  problem  for  linear  systems  subject  to  input  saturation  were  first  formulated  in 
References  [15,  16]  as  follows. 

Problem  2.1 

Consider  system  (1)  and  a  compact  set  ifo  c  R5.  The  semi-global  state  feedback  regulator 
problem  is  defined  as  follows: 

For  any  a  priori  given  (arbitrarily  large)  bounded  set  92 o  find,  if  possible,  a  static 

feedback  law  u  =  a(x,  w)  such  that 

(i)  The  equilibrium  x  =  0  of 

x+  =  Ax  +  Bo(a(x,  0))  (4) 

is  asymptotically  stable  with  SC 0  contained  in  its  basin  of  attraction; 

(ii)  For  all  x(0)  e  SC0  and  w(0)  e  YC0,  the  solution  of  the  closed-loop  system  satisfies 

lim  e(k)  =  0  (5) 
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Problem  2.2 

Consider  system  (1)  and  a  compact  set  a  W.  The  semi-global  linear  observer-based  error 
feedback  regulator  problem  is  defined  as  follows: 

For  any  a  priori  given  (arbitrarily  large)  bounded  sets  ST0  c  R"  and  c  IR"+J,  find,  if  possible, 

an  error  feedback  law  of  the  form 


u  =  a(x,  w) 


(6) 


such  that 

(i)  The  equilibrium  (x,  x,  w)  =  (0, 0,  0)  of 
x+  —  Ax  +  B<j(a.(x,  w)) 


/x+\  (A  P\(x\  (B\  (Lf\  Vx  — x\ 

\w+/  VO  Sj\wJ  \0J  \LSJ  V  ~w  J 


(7) 


is  asymptotically  stable  with  x^f0  contained  in  its  basin  of  attraction. 

(ii)  For  all  (x(0),  x(0),  w(0))  e  9C0  x  2£a  and  w(0)  e  #"0,  the  solution  of  the  closed-loop  system 
satisfies 

lim  e(k)  =  0.  (8) 

k-+  oo 


The  solvability  conditions  for  these  problems  were  also  established  in  Reference  [16]  and  are 
recalled  as  follows. 


Theorem  2.3 

Consider  system  (1)  and  the  given  compact  set  'W 0  <=  Rs.  The  semi-global  state  feedback 
regulator  problem  is  solvable  if 

(i)  {A,  B)  is  stabilizable  and  A  has  all  eigenvalues  inside  or  on  the  unit  circle; 

(ii)  There  exist  matrices  II  and  T  such  that: 

(a)  They  solve  the  following  linear  matrix  equations: 

ns  =  ylll  +  BT  +  P 

o  =  cn  +  Q  (9) 

(b)  There  exist  a<5>0andaK^0  such  that  HTwIL,*  <  1  -  5  for  all  w  with  w(0)  e  iPQ. 
Theorem  2.4 

Consider  system  (1)  and  the  given  compact  set  Wq  <=  Rs.  The  semi-global  linear  observer-based 
error  feedback  regulator  problem  is  solvable  if 
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(i)  (A,  B)  is  stabilizable  and  A  has  all  eigenvalues  inside  or  on  the  unit  circle;  Moreover,  the 
pair 


is  detectable; 

(ii)  There  exist  matrices  II  and  T  such  that: 

(a)  They  solve  the  following  linear  matrix  equations: 

IIS  =  ATI  +  BT  +  P 

o  =  cn  +  Q 


(10) 


(b)  There  exists  a<5>0andaK>0  such  that  HTwIU,*  <  1  -  5  for  all  w  with  w(0)  6  tT0. 

Linear  low-gain  feedback-based  regulators  that  solve  the  above  problems  were  also  explicitly 
constructed  in  Reference  [16].  The  necessity  of  these  solvability  conditions  was  also  discussed  in 
Reference  [16]. 

As  explained  in  the  introduction,  this  low-gain-based  design  results  in  under-utilization  of  the 
available  control  capacity.  The  goal  of  this  paper  is  to  provide  a  new  design  methodology  which 
incorporates  significant  improvement  to  the  low-gain  design  technique  as  developed  in  Refer¬ 
ences  [8,  10]  and  leads  to  fuller  utilization  of  the  available  control  capacity  and  hence  better 
closed-loop  performance.  We  will  also  show  that  this  new  design  methodology  is  also  applicable 
to  the  so-called  generalized  output  regulation  problems  we  formulated  earlier  in  References 
[15,  16], 


3.  AN  IMPROVED  DESIGN  FOR  THE  STATE  FEEDBACK  REGULATOR 

In  this  section  we  construct  a  family  of  nonlinear  state  feedback  laws,  parameterized  in  s  and  p, 
and  then  show  that  such  a  family  of  state  feedback  laws  solves  the  semi-global  output  regulation 
problem.  Significant  improvement  on  the  closed-loop  performance  over  the  earlier  design  [16]  is 
then  shown  by  an  example. 

This  family  of  nonlinear  feedback  laws  reduces  to  a  linear  one  for  the  single  input  case  (m  =  1), 
that  is,  the  function  a(x,  w)  as  in  Problems  2.1  and  2.2  reduces  to  the  form  of  Fx  +  Gw. 

The  new  state  feedback  regulator  design  is  carried  out  in  the  following  two  steps. 

Step  1  ( Solution  of  an  algebraic  Riccati  equation ): 

We  start  by  choosing  a  continuous  function  H:  (0, 1)  -*  OT  * "  such  that  H(s)  is  positive  definite 
for  each  e  e  (0, 1]  and 

lim  H(e)  =  0  (11) 

E  “♦  0 

While  a  simple  choice  of  H(s)  is  H{e)  =  si,  the  choice  of  H(e)  does  significantly  affect  the 
closed-loop  performance.  We  leave  the  issue  of  judicious  choice  of  H(e)  for  future  investigation. 

X  =  A'XA  +  H(e)  -  A'XB(B'XB  +  /)'  lB'XA,  e  e  (0, 1]  (12) 
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We  now  recall  the  following  lemmas  regarding  the  properties  of  the  Riccati  equation  (12)  from 
Lin  et  al.  [10]. 

Lemma  3.1 

Assume  that  (A,  B)  is  stabilizable  and  all  the  eigenvalues  of  A  are  located  inside  or  on  the  unit 
circle.  Then,  for  any  e  e  (0, 1],  there  exists  a  unique  matrix  X(e)  >  0  which  solves  the  algebraic 
Riccati  equation  (12)  and  is  such  that  A  -  B(B'X(e)  B  +  I)~1B'X(s)  A  is  Schur  stable.  Moreover, 

lim  2f(e)  =  0  (13) 

t~>0 


Lemma  3.2 

Assume  that  (A,  B)  is  stabilizable  and  all  the  eigenvalues  of  A  are  located  inside  or  on  the  unit 
circle.  Then,  there  exists  an  e*  6  (0, 1]  such  that,  for  e  e  (0,  e*], 

||2£T1/2(e)AX-1/2(8)||  <^2  (14) 

Step  2  (Composition  of  state  feedback  laws): 

u  =  —  [F(e)  +  pfc(x,  w)  ,K(e)](x  —  IIvv)  +  Tw,  p  e  [0,  2]  (15) 

where  F(e)  =  (B'X(s)  B  +  I)~  lB’X(e)  A,  K(e)  =  (B'X(e)B)-1B'X(e)Ac,  Ac  =  A  —  BF(e),  with  X(s) 
being  the  solution  of  the  Riccati  equation  (12),  and  k:  R"  x  IRs  -►  IR+  is  defined  as 

k(x,  w)  =  max  {z:  |  —  [F(e)  +  pzK(e) ]  (x  —  IIw)  +  Tw^  <  1}  (16) 

ze[0, 1] 

If,  in  the  above  maximization,  there  exists  no  z  for  which  the  inequality  is  satisfied  then  z  is  chosen 
equal  to  0.  Moreover,  for  the  case  of  single  input  (i.e.  m  =  1),  we  can  choose 

k(x,w)=  1  (17) 


Remark 

We  note  that  when  p  =  0  the  new  state  feedback  laws  as  given  in  (15)  reduce  to  the 
low-gain-based  linear  state  feedback  laws  as  given  in  Reference  [16]  and  is  e  referred  to  as 
a  low-gain  parameter.  Moreover,  it  will  become  clear  shortly  that  the  choice  of  K(e)  guarantees 
that,  for  any  p  e  [0,  2],  the  family  of  state  feedback  laws  (15)  also  solves  the  semi-global  linear 
state  feedback  output  regulation  problem.  A  non-zero  value  of  p  represents  fuller  utilization  of  the 
actuator  capacity.  While  the  use  of  the  freedom  in  the  choice  of  p  needs  to  be  further  explored  for 
achieving  control  objectives  beyond  semi-global  output  regulation,  we  will  demonstrate  its 
contribution  to  the  improvement  of  the  closed-loop  transient  performance  in  the  output  regula¬ 
tion  problems. 

We  then  have  the  following  results. 

Theorem  3.3 

Consider  system  (1)  and  the  given  compact  set  iP o  c:  IR5.  Assume  the  sufficient  conditions  of 
Theorem  2.3  are  satisfied.  Then  the  family  of  state  feedback  laws  as  given  in  (15)  solves  the 
semi-global  state  feedback  regulator  problem. 
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More  specifically,  for  any  a  priori  given  (arbitrarily  large)  bounded  set  2£0  <=  IRn,  there  exists  an 
e*  e  (0, 1]  such  that  for  each  e  e  (0,  £*]  and  for  each  p  e  [0,  2], 

(i)  The  equilibrium  x  =  0  of 

x+  =  Ax  +  B<x( -(. F(e)  +  Pk(x,  0)  K(e))  x)  (18) 

is  locally  exponentially  stable  with  SC0  contained  in  its  basin  of  attraction. 

(ii)  For  all  x(0)  e  3C0  and  w(0)  eW0,  the  solution  of  the  closed-loop  system  satisfies 

lim  e(k)  =  0  (19) 

k~*  oo 

Proof.  We  prove  this  theorem  by  showing  that  for  each  given  bounded  set  SF0,  there  exists  an 
e*  E  (0, 1]  such  that  for  all  e  e  (0,  £*)  and  all  p  e  [0, 2],  both  items  (i)  and  (ii)  of  the  theorem  hold. 

We  first  show  that  there  exists  an  af  e  (0, 1]  such  that  for  each  e  e  (0,  £*)  and  each  p  e  [0,  2],  (i) 
holds.  To  this  end,  rewrite  (18)  as 

x+  =  Acx  +  £[>(  — (F(e)  +  px(x,  0)  K(e))x)  +  F(e)x]  (20) 

Consider  the  Lyapunov  function 

Ft(x)  =  x'X{e)x  (21) 

and  let  cx  >  0  be  such  that 

c'i  ^  sup  x'X  (e)x  (22) 

xe&0,  £6(0, 1) 

Such  a  ct  exists  since  lim£_0  X(e)  =  0  by  Lemma  3.1  and  2£0  is  bounded.  We  note  here  that  such 
a  ct  guarantees  that  SC0  a  Lyjc^.  Vc  s  (0, 1],  where  the  level  set  Lv,{ci)  is  defined  as 
Ly,(ci)  =  {x  e  R":  Ki(x)  <  cj.  Let  £f  be  such  that  for  all  £  e  (0,  £*],  x  e  LKl(ct)  implies  that  | F(s) 
x^  <  1.  Such  an  e*  exists  because  of  Lemma  3.2  and  the  fact  that  lim£_,0  X(e)  =  0.  Note  also  that 
from  (12)  it  follows 

A'  X(e)Ac  -  X(s)  =  -  H(s)  -  F’(s) F{s)  (23) 

By  the  definition  of  k,  (16),  for  all  x  e  LVl(ci),  the  saturation  functions  in  the  closed-loop  system 
(20)  operate  in  their  respective  linear  regions,  and  hence  the  control  input  remains  unsaturated. 
The  evaluation  of  the  deference  of  along  the  trajectories  of  this  linear  closed-loop  system 
shows  that,  for  x  e  Lv,{ci), 

Fx(x+)  —  Ft(x)  =  —  x'H  (fi)  x  —  x'F'(fi)  F(s)x 

-  pk(x,  0)  [2  -  pk(x,  0 )]x'A’cXB{B'XB)-lB'XAcx 

<  -  x'H{e)  x  (24) 

Now  consider  the  choice  of  k(x,  w)  =  1  for  the  single  input  case,  the  evaluation  of  the  difference  of 
Vi  along  the  trajectories  of  (18)  inside  the  set  Lyfcj)  gives 

F1(x+)  -  Fj(x)  =  -  x'H(£)x  -  x'F'(£)  F(£)x  + 
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where  0x(yx)  =  2x'A'cX(e)  Byt  +  ylB'X(e)By1  and 

Vi  =  <r(— (F(e)  +  p(B'X(e)B)-1B'X(e)Ac)  x )  +  F(s)x 
Denoting  Mi  =  -  F(e)  x  and  vx  =  -  K{e)  x,  <t>i(yi)  can  be  written  as 
<Pi(yi)  —  —  2v1(B'X(e)B)  [cr^!  +  pvx)  —  px] 

+  IX^i  +  pvx)  -  Mi]  (B'X(s)B)  [<j(Ml  +  pVx)  -  Ml] 

=  |>(Bi  +  pvx)  -  (Mi  +  2vx)](B'AT(e)B)I>(MX  +  pvx)  -  Pil 
Noting  that  p  e  [0, 2],  the  definition  of  a  and  for  all  x  e  Lv,(cx),  ImiI  <  1,  we  have 
iMi  +  pvi I  1  =>  4>i(yi)  =  -  p(2  -  p){B'X{e)B)v\  <  0 

Pi  +  pvi  >  1  =>  vx  >  0,  o-(mi  +  pvx)  -  (mi  +  pvx)  <  0 

=>  <t>i(yi)  <  -  (2  -  p)  (B'X(e)B)vx[  1  -  Mi]  ^  0 

and 

Mi  +  PVi  <  -  1  =>  vx  <  0,  <t(mi  +  pvx)  -  (pi  +  pvj)  >  0 

=>  <t> i(7i)  <  -  (2  -  p)  (B'X(e)B)vx[- 1  -  Mi]  <  0 

We  conclude  that  for  all  x  e  LKl(cx),  </>x(yx)  <  0  and  hence  Fx(x+)  —  Fx(x)  <  —  x'H(e)x. 

So  far,  we  have  shown  that  both  for  the  multiple  input  and  single  input  case, 

Fx(x+)  -  Fx(x)  -  x’H (e)x,  Vx  e  LVi(cx)  .  (25) 

which  implies  that  the  closed-loop  system  (18)  is  locally  exponentially  stable  with  2F0  contained  in 
its  basin  of  attraction.  We  note  here  that  the  choice  of  p  determines  the  decay  rate  of 
Fx(x+)  —  Fx(x)  and  hence  the  freedom  in  choosing  p  can  be  utilized  to  ensure  fast  convergence. 

Next,  we  show  that  there  exists  an  e*  e(0, 1]  such  that  for  each  e  e  (0,  s*],  item  (ii)  of  the 
theorem  holds. 

To  this  end,  let  us  introduce  an  invertible,  triangular  co-ordinate  change  £  =  x  —  IIw.  Using 
condition  (ii)  (a)  (see  Theorem  2.3),  we  have 

=  x+  -  riw+ 

=  Ax  +  B<r(u)  +  Pw  —  IISw 

=  A£  +  B[a(u)  -  Tw]  (26) 

With  the  family  of  state  feedback  laws  given  by  (15),  the  closed-loop  system  can  be  written  as 

£+  =  +  B[<t(Tw  -  (F(e)  +  pic(£  +  IIw,  w)K(e){)  -  Tw] 

=  A£  +  B[ff(rw  -  (F(e)  +  pk{£,  +  IIw,  w)K(e))£)  —  Iw  +  F(e)f]  (27) 

By  Condition  (ii)  (b)  (see  Theorem  2.3),  ||rw||OT,K  <  1  -  5.  Moreover,  for  any  x(0)e  SC0  and  any 
w(0)  e  i *(K)  belongs  to  a  bounded  set,  say  °UK,  independent  of  e  since  &0  and  H* o  are  both 

bounded  and  £{K)  is  determined  by  a  linear  difference  equation  with  bounded  inputs  cr(-)  and  Tw. 
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We  then  pick  a  Lyapunov  function 

v2^)  =  ^'xm 


and  let  c2  >  0  be  such  that 


(28) 


c2  ^  sup  %X(e)E,  (29) 

$eWK,Ee{0, 1] 

Such  a  c2  exists  since  X(e)  and  <%K  are  bounded.  Let  ef  e  (0, 1]  be  such  that  £  e  LVl(c2)  implies  that 
|F(e)^|  <  <5  where 

LVl(c2)  =  {teMn\V2(Z)<c2} 

The  existence  of  such  an  e *  is  again  due  to  Lemma  3.2  and  the  fact  that  lim£-,0X(s)  =  0. 

By  the  definition  of  function  k,  (16),  for  all  x  e  LVi(c2)  and  k>K,  the  saturation  functions  in  the 
closed-loop  system  (27)  operate  in  their  respective  linear  regions,  and  hence  the  closed-loop 
system  reduces  to 

<T  =  +  Pk(Z  +  nw,  w)  B(B'X(e)B)-1B'X(e)A^  (30) 

The  evaluation  of  the  deference  of  V2  along  the  trajectories  of  this  linear  closed-loop  system 
shows  that,  for  l;  e  LVl(c2), 

V2(Z+)  ~  V2(0  =  -  -  Z'F(e)F(e)Z 

-  [2  -  px(£  +  nw,  w)]  £'A'CXB(B’XB)- lB'XAc£ 

<  -  Z'H(sK  (31) 

Now  consider  the  choice  k(x,  co)  =  1  for  the  single  input  case,  the  evaluation  of  the  difference  of  V, 
k^K,  inside  the  set  LVj(c2),  using  (23),  now  shows  that  for  all  £  e  LVl(c2), 

ViiC)  -  Vitt)  =  -  ~  Z'F'(e)F(e){  +  4>2(y2)  (32) 

where  <f>2(y 2)  =  2£'A'cX(e)  By2  +  y2B'X(e)  By2  and 

y2  =  <r(Tw  -  (F(e)  +  p(B'X(s)B)-LB’X(e)Ac){)  -Tw  +  F(e){ 

Denoting  02  =  Tw,  p2  =  -  F(e)£,  and  v2  =  -  K(e)£,  <j)2(y2)  can  be  written  as 

<t>2(y2)  =  -  2 v2(B'X(e)B)  [<t(02  +  p2  +  pv2)  -  02  -  p2] 

+  0(02  +  Pi  +  pv2)  -02-  p2](B'X(e)B)  [<r(02  +  p2  +  pv2)  -02-  p2] 

=  [tr(02  +  p2  +  pv2)  —  (02  +  p2  +  2v2)]  {B'X(e)B)  [a(02  +  p2  +  pv2)  —  02—  p2] 

Noting  that  p  e  [0,  2],  the  definition  of  a  and  for  all  <!;  e  LVl(c2),  \02  +  p2\  <  1,  we  have 

\02  +  p2  +  pv2|  ^  1  =>(t>2{y2)  =  p( 2  —  p)(B  X(e)B)v2  sS  0 

02  +  Pi  +  pv2  >  1  =>  v2  >  0,  c t{02  +  p2  +  pv2)  -  (02  +  p2  +  pv2)  <  0 

=*  02(y2)  <  -  (2  -  p)(B'X(£)B)v2[l  -  (02  +  p2)]  0 
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and 

02  +  V-2  +  pv2  <  “  1  =>  V2  <  0,  <x(02  +  A*2  +  pv2)  -  (02  +  p2  +  pv2)  >  0 

=>  Uyi)  «  -  (2  -  p)(S'X(6)B)v2[  -  1  -  (02  +  p2)]  <  0 

We  conclude  that  for  all  £eLKl(c2),  <p2(y2)  <  0  and  hence  V2(i+)  -  V2(Q  <  -  This 

shows  that  any  trajectory  of  the  closed-loop  system  (27)  starting  from  {£  =  x  —  IIw: 
x  6  SCq ,  w  g  T^o}  remains  inside  the  set  LVl(c2)  and  approaches  the  equilibrium  £  =  0  as  k  -+  oo, 
which  implies  that  e(fc)  =  C£(/c)  ->0  as  k  ->  oo. 

Finally,  setting  £*  =  min{£*,  c* },  we  conclude  our  proof  of  Theorem  2.3.  □ 

Remark 

As  is  clear  from  the  above  derivation,  the  choice  of  k(x,  w)  as  in  (16)  prevents  the  control  input 
from  saturating  the  actuators  while  increasing  the  utilization  of  their  capacities.  While  the 
avoidance  of  actuator  saturation  is  essential  in  establishing  (24)  due  to  multiinput  coupling,  the 
choice  of  k(x,  w)  s  1  for  single  input  case  allows  the  control  input  to  saturate  the  actuators  and 
thus  further  increase  the  utilization  of  their  capacities. 

We  now  illustrate  the  state  feedback  design  by  an  example. 

Example  3.4 

Consider  the  following  system: 


with  w(0) g  iT0  where  i^0  =  {we  R 2:  || w||  <  0.9}.  It  is  straightforward  to  show  that,  the  solvabil¬ 
ity  conditions  for  the  semi-global  linear  state  feedback  output  regulation  problem  are  satisfied. 
More  specifically,  the  matrices, 


n  =  ^o  r  =  (i  o)  (34) 

solve  the  linear  matrix  equations  (10).  Also,  8  =  0.1,  since  lirwll*  <  0.9  for  all  w(0)  e  #"0.  Let  the 
set  SC, o  be  given  by  SC0  =  {x  e  R4 :  ||x||  <  10}. 

Then,  following  the  proof  of  Theorem  3.3,  a  suitable  choice  of  s*  is  6.628  x  10“6.  For  e  =  s*  and 
p  =  1,  the  feedback  law  (15)  is  given  by 

u  =  (0.3037  0.1523  -  0.2403)x  +  (0.9366  -0.1523)w 
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Figure  1.  s  =  6.628  x  10  6,  p  =  1:  (a)  et;  (b)  e2;  (c)  c t(u). 


For  the  initial  conditions  x(0)  =  (6,  6,  -  2)',  w( 0)  =  (0.45,  -  0.45)',  Figure  (1)  shows  the  control 
action  and  the  closed-loop  performance  of  the  regulator  for  p  =  1.  Figure  (2)  shows  the  control 
action  and  the  closed-loop  performance  of  the  regulator  design  in  Reference  [16],  i.e.  for 

P  =o. 


4.  AN  IMPROVED  DESIGN  FOR  THE  ERROR  FEEDBACK  REGULATOR 

This  section  provides  an  improved  design  for  the  error  feedback  regulators.  Significant  improve¬ 
ment  on  the  closed-loop  performance  over  the  earlier  design  [16]  is  again  shown  by  an  example. 
The  strategy  taken  in  the  new  design  is  to  implement  the  new  state  feedback  regulators  as 
constructed  in  the  previous  section  with  the  state  of  a  fast  linear  observer.  The  observer  is  chosen 
to  be  of  a  deadbeat-type.  Arbitrary  fast  observers  can  also  be  used,  however,  the  use  of 
a  deadbeat-type  observer  simplifies  our  proof  drastically  since  the  states  of  the  system  will  be 
exactly  the  same  as  those  of  the  observer  in  a  finite  time.  More  specifically,  the  new  linear 
observer-based  error  feedback  regulator  takes  the  following  form: 

x+  =  Ax  +  Ba(u)  +  Pw  +  LAe  -  LA(Cx  +  Qw) 

w+  —  Sw  +  LjC  —  Ls(Cx  +  Qw) 

u  =  -  (F(s)  +  Pk(x,  w)K(e))x  +  ((F(e)  +  p;c(x,  w)K(e))II  +  T)w  (35) 
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Figure  2.  e  =  6.628  x  10  6,  p  =  0.  (a)  et;  (b)  e2\  (c)  a(u). 


where  F(e)  =  (B'X(s)B  +  l)~lB'X{t)A,  K(e)  =  (B^B^FXteRwith  X(e)  being  the  solution 
to  the  Riccati  equation  (12),  and  the  function  tc  is  as  defined  by  (16)  [or  (17)]].  The  matrices 
La  and  Ls  are  chosen  such  that  all  eigenvalues  of  the  following  matrix: 


A  = 


'A  -  LaC 
,  ~LSC 


P-LaQ\ 

S-Lsq) 


are  at  the  origin.  Here  we,  of  course,  assumed  that  the  pair 


(36) 


(37) 


is  observable. 

We  have  the  following  results. 

Theorem  4.1 

Consider  system  (1)  and  the  given  compact  set  c  K5-  Assume  the  sufficient  conditions 
of  theorem  2.4  are  satisfied.  In  addition,  assume  that  the  pair  (37)  is  observable.  Then  the 
error  feedback  laws  (35)  solves  the  semi-global  linear  observer-based  error  feedback  regulator 
problem. 

More  specifically,  for  any  a  priori  given  (arbitrarily  large)  set  SC0  c  IR"  and  c  Kn+S,  there 
exists  an  e*  e  (0, 1],  such  that  for  each  p  e  [0, 2], 
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(i)  The  equilibrium  (x,  x,  w)  =  (0, 0,  0)  of 


x+  =  Ax  +  Bo(u) 


u  -  —  (F(e)  +  pic(x,  w)K(s))x  +  ((F(e)  +  px(x,  w)K(e))II  4-  T)w) 


is  asymptotically  stable  with  x  fF0  contained  in  its  basin  of  attraction. 

(ii)  For  all  (x(0),  x(0),  w(0))  and  w(0)  e  tT0,  the  solution  of  the  closed-loop  system 

satisfies 

lim  e{k)  =  0.  (39) 

k~*  oo 


Proof.  With  the  family  of  feedback  laws  as  given  by  (35),  the  closed-loop  system  consisting  of 
system  (1)  and  the  dynamic  error  feedback  laws  (35)  can  be  written  as  (we  do  not  write  the 
equation  w+  =  Sw  explicitly  but  it  is,  of  course,  always  there): 

x+  =  Ax  +  Bo(u)  +  Pw 

x+  =  Ax  +  Bo{u)  +  Pw  +  LAC{x  -  x)  +  LaQ{w  -  w) 

(40) 

w+  =Sw  +  LsC(x  —  x)  +  LsQ(w  -  w) 
u  =  -  (F(e)  +  pjc(x,  w)K(e))x  +  ((F(e)  +  pic{x,  w)iC(e))II  +  T)vv 
We  then  adopt  the  invertible  change  of  state  variable, 

x  =  x  —  x,  w  =  w  —  w  (41) 


and  rewrite  the  closed-loop  system  (40)  as 

x+  =  Ax  +  Bo(Tw  —  (F(e)  +  px(x  —  x,  w  —  w)K(e))(x  —  II w))  +  Pw 

x+  =  (A  -  LaQx  +  (P  -  LaQ)w  (42) 

vv+  =  —  LsCx  +  (S  —  LsQ)w 

Since  all  eigenvalues  of  A  are  at  the  origin,  it  is  easy  to  verify  that  for  time  k  >  n  +  s,  x(k)  =  0  and 
w(k)  =  0.  As  a  result,  for  k^n  +  s,  x(k)  =  x{k)  and  w(k)  =  w(fc)  .  On  the  other  hand,  for  all 
x(0)  g  X0,  (x(0),  w(0))  e  &0  and  w(0)  g  x(n  +  s )  belongs  to  a  bounded  set.  Hence,  the  rest  of 
the  proof  becomes  the  same  as  the  proof  of  Theorem  2.3.  □ 

Example  4.2 

We  consider  the  same  plant  and  the  exosystem  as  in  Example  3.4.  However,  this  time,  the  state 
x  and  w  are  not  available  for  feedback,  which  forces  us  to  use  error  feedback  regulators.  Let  the 
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sets  iT0  =  {we IR2:  ||w||  < 0.9}  and  &0  =  {xeR*:  ||x||  <  10}.  Let  the  set  iT0  be  given  by 
&0  =  {zeR6:  ||z||  <  2}.  Following  the  proof  of  Theorem  4.1,  a  suitable  choice  of  e*  is 
6.628  x  10" 6.  It  can  be  verified  that  the  matrix  A  as  defined  in  (36)  has  all  its  eigenvalues  located  at 
the  origin  if  we  choose 


/  0.3748 

-0.8750  \ 

(  0.25 

-  0.25  \ 

[  1.3752 

0.1250  j 

Ls  =  1  _ _ 

-0.125/ 

V  -  0.3752 

V- 0.6252 

-0.8750  / 

For  s  =  e*  and  p  =  1,  the  feedback  laws  (35)  are  given  by 

x+  =  Ax  +  B<t(u)  +  Pw  +  LaC{x  -  x)  +  LaQ(w  -  w) 


w+  =  Sw  +  LsC(x  -  x)  +  LsQ(w  -  w) 

u  =  -(-0.3037  -0.1523  0.2403)  x 

+  (0.9366  —  0.1523)w  (43) 

For  the  initial  conditions  x(0)  =  (— 6, 2, 6)',  w(0)  =  (0.45,  —  0.45)',  x(0)  =  (0, 0, 0, 0)', 

vO(0)  =  (0, 0)',  Figure  (3)  shows  the  control  action  and  the  closed-loop  performance  for  the 


c 


Figure  3.  e  =  6.628  x  10  6,  p  -  1.  (a)  et;  (b)  e2\  (c)  £r(u). 


Copyright  ©  2000  John  Wiley  &  Sons,  Ltd. 


Int.  J.  Robust  Nonlinear  Control  2000;  10:117-135 


ACTUATOR  SATURATION  NONLINEARITY 


131 
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dynamic  error  feedback  regulator  for  p  =  1.  Figure  (4)  shows  the  control  action  and  the 
closed-loop  performance  of  the  dynamic  error  feedback  regulator  design  in  Reference  [16],  i.e.  for 


P  =  o. 


5.  GENERALIZED  SEMI-GLOBAL  OUTPUT  REGULATION  PROBLEMS 

In  an  effort  to  broaden  the  class  of  disturbance  and  reference  signals,  in  References  [15, 16],  we 
formulated  the  generalized  semi-global  feedback  regulator  problems,  in  which  an  external  driving 
signal  to  the  exosystem  is  included.  More  specifically,  we  consider  a  multivariable  system  with 
inputs  that  are  subject  to  saturation  together  with  an  exosystem  that  generates  disturbance  and 
reference  signals  as  described  by  the  following  system: 

x+  =  Ax  +  Ba(u)  +  Pw 

w+  =  Sw  +  r  (44) 

e  =  Cx  +  Qw 

where  jcelR",  well?',  ueRm,  eeMp,  reLx  is  an  external  signal  to  the  exosystem,  and  a  is 
a  vector-valued  saturation  function  as  defined  in  Section  2. 

The  generalized  semi-global  state  feedback  regulation  problem  and  the  generalized  semi-global 
linear  observer-based  error  feedback  regulation  problem  are  formulated  as  follows. 
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Problem  5.1 

Consider  system  (44),  two  compact  sets  c  R5  and  01  <=.  L„.  The  generalized  semi-global  state 
feedback  regulator  problem  is  defined  as  follows: 

For  any  a  priori  given  (arbitrarily  large)  bounded  set  <=  IR",  find,  if  possible,  a  static 
feedback  law  u  —  a(x,  w,  r),  such  that 

(i)  The  equilibrium  x  =  0  of 

x*  =  Ax  +  B<j(<j{a(x,  0,  0))  (45) 

is  locally  aymptotically  stable  with  Xo  contained  in  its  basin  of  attraction; 

(ii)  For  all  x(0)  e  Xo,  *v(0)  e  iT0  and  re  Si,  the  solution  of  the  closed-loop  system  satisfies 

lim  e(k)  =  0.  (46) 

k->  oo 


Problem  5.2 

Consider  system  (44)  and  two  compact  sets  c  U5  and  01  c  Lx.  The  generalized  semi-global 
linear  observer-based  error  feedback  regulator  problem  is  defined  as  follows. 

For  any  a  priori  given  (arbitrarily  large)  bounded  sets  c:  !Rn  and  c  IRn+s,find,  if  possible, 

a  linear  observer-based  error  feedback  law  of  the  form: 


such  that 
(i)  The 


is  locally  asymptotically  stable  with  2£0  x  contained  in  its  basin  of  attraction; 

(ii)  For  all  x(0),  x(0),  w(0)  eSC^x  2£0,  w(0)  e  tT0,  and  all  re  SI,  the  solution  of  the  closed-loop 
system  satisfies 

lim  e{k)  =  0.  (49) 

k->  oo 

In  this  section  we  show  that  the  improved  design  technique  as  developed  in  the  previous  two 
sections  can  also  be  used  to  construct  the  regulators  to  solve  the  generalized  semi-global  output 
regulation  problems.  We  summarize  these  results  in  the  following  two  theorems. 

Theorem  5.3 

Consider  system  (44)  and  given  compact  sets  /W0c.Us  and  M  c:  LOT.  If 

(i)  (A,  B)  is  stabilizable  and  A  has  all  its  eigenvalues  on  or  inside  the  unit  circle. 

(ii)  There  exist  matrices  II  and  T  such  that: 


ro-c  ;)(:)*(:)•»*(:>*©[-«  «C)] 


u  =  oc(x,  vv,  r) 


(47) 


equilibrium  (x,  x,  w)  =  (0, 0,  0)  of 
x+  =  ^4x  +  Ba(a(x,  w,  0)) 


/x+\  (A  P\(x\  f B\  #  /A  A 
(  A+  =  L  JL  +  L  ) ff(a(x,  w,  0)) 
\w  /  \0  S/\w/  \0 / 


+  1  \A  )(C  2) 


(•:.*)] 


(48) 
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(a)  They  solve  the  following  linear  matrix  equations: 

ns  =  All  +  BT  +  P 
o  =  cn  +  Q 


(50) 


(b)  For  each  ref,  there  exists  a  function  feL„  such  that  nr  =  Br. 

(c)  There  exists  a  <5  >  0  and  a  K  ^  0  such  that  ||Tw  +  r||  cc.k  ^  1  —  8  for  all  w  with 
w(0)  e  if o  and  all  r  e  01. 

Then  the  following  family  of  state  feedback  laws  solves  the  generalized  semi-global  state  feedback 
output  regulation  problem, 

u  =  -  [F(e)  +  pK{x>  w)  K(£)]x  +  [(F(s)  +  pK(x,  w)X(s))n  +  r>  +  f,  p  6  [0,  2]  (51) 

where,  F(e)  =  (B'X(e)B  +  I)~l B'X(e)A,K(s)  =  (BX{e)By1BX(£}A,  Ac  =  A  —  BF(e) ,  with  X(e) 
being  the  solution  of  the  Riccati  equation  (12)  and  the  function  k  is  as  defined  by  (16). 

More  specifically,  for  any  a  priori  given  (arbitrarily  large)  bounded  set  3T  e  IR",  there  exists  an 
t  e  (0, 1]  such  that  for  each  e  e  (0,  e*)  and  for  each  p  e  [0, 2], 

(i)  The  equilibrium  x  =  0  of 

x+  =  Ax  +  Bo(  —  F(e)x  —  ptc(x,  0)K(e)x) 

is  locally  exponentially  stable  with  SCQ  contained  in  its  basin  of  attraction. 

(ii)  For  all  x(0)  e  &0,  w(0)  e  tT0,  and  ref,  the  solutions  of  the  closed-loop  system  satisfies 

lim  e(k)  =  0 


Proof.  The  proof  is  similar,  mutatis  mutandis  to  that  of  Theorem  3.3,  except  that  (27)  takes  the 
following  slightly  different  form: 

£+  =  Ac£  +  B[oTw  +  r-  (F(e)  +  px(x,  w)K(e)£)  -  Tw  +  F(s)^  -  r]  □ 


Theorem  5.4 

Consider  system  (44)  and  the  given  compact  sets  #"0  c  Rs  and  <%<=.LX.  If 

(i)  {A,  B)  is  stabilizable  and  A  has  all  its  eigenvalues  inside  or  on  the  unit  circle.  Moreover,  the 
pair 


is  observable; 

(ii)  There  exist  matrices  II  and  T  such  that: 

(a)  They  solve  the  following  linear  matrix  equations: 


TLS  =  ATI +  BT  +  P 

o  =  cn  +  Q 


(52) 


(b)  For  each  ref,  there  exists  a  function  r  e  L„_  such  that  Ilr  =  Br  for  all  k  ^  0. 

(c)  There  exist  a  8  >  0  and  a  K  ^  0  such  that  ||Tw  +  r  Hco.k  ^  1  —  8  for  all  w  with 
w(0) e if~0  and  all  ref. 


Copyright  ©  2000  John  Wiley  &  Sons,  Ltd. 


Int .  J .  Robust  Nonlinear  Control  2000;  10:117-135 


134 


Z.  LIN  ET  AL. 


Then,  the  following  family  of  linear  observer-based  error  feedback  laws  solves  the  generalized 
semi-global  linear  observer-based  error  feedback  output  regulation  problem. 

x+  =  Ax  +  Btr(u)  +  Pw  +  LAe  —  LA(Cx  +  Qw) 

w+  =  Sw  +  Lse  -  Ls(Cx  +  Qw)  +  r  (53) 

u  =  —  (F(e)  +  px(x,  w)K(e))x  +  ((F(e)  -f  p»c(x,  vv)K(e))Il  +  T)vv  +  r 

with  2f(e)  being  the  solution  of  the  Riccati  equation  (12),  and  the  function  k  is  as  defined  by  (16). 
The  matrices  LA  and  Ls  are  chosen  such  that  all  eigenvalues  of  the  following  matrix: 


( A-LaC  P-LaQ\ 
\-LsC  S-LsQj 


(54) 


are  at  the  origin. 

More  specifically,  for  any  a  priori  given  (arbitrarily  large)  bounded  set  3T0  £  R"  and  2?0  e  R"+,) 
there  exists  an  e*  e  (0, 1]  such  that  for  each  e  e  (0,  e*)  and  for  each  p  e  [0, 2], 


(i)  The  equilibrium  (x,  x,  w)  =  (0, 0,  0)  of 

x+  =  ^4x  -I-  Bo(u) 

co-c  ,x)*(.>-c)-e)«  h  -V)  » 

u  =  —  (F(e)  +  px(x,  w)K(e))x  +  ((F(e)  +  px(x,  w)K(e))II  +  T)w 

is  asymptotically  stable  with  3T0  x  £?0  contained  in  its  basin  of  attraction. 

(ii)  For  all  (x(0),  x(0),  w(0))  e  SC0  x  ^o.  w(0)  e  and  all  rzSk,  the  solution  of  the  closed-loop 

system  satisfies 

lim  e(k)  =  0  (56) 

k~>  oo 


Proof,  The  proof  is  similar  to  that  of  Theorem  4.1. 


□ 


6.  CONCLUSIONS 

New  regulators  were  constructed  to  solve  the  semi-global  output  regulation  problems  for  linear 
discrete-time  systems  subject  to  input  saturation.  These  regulators  make  better  use  of  the 
available  control  capacity  to  achieve  better  closed-loop  system  performance. 
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Abstract — A  complete  stability  analysis  is  performed  on  a  planar 
system  of  the  form  x  =  cr(  Ax)  where  A  is  a  Hurwitz  matrix  and 
cr  is  the  saturation  function.  Necessary  and  sufficient  conditions  for 
the  system  to  be  globally  asymptotically  stable  (GAS)  or  to  have  a 
closed  trajectory  are  explicitly  given  in  terms  of  the  entries  of  A. 
These  conditions  also  indicate  that  the  system  always  has  a  closed 
trajectory  if  it  is  not  GAS. 

Index  Terms — Closed  trajectories,  neural  networks,  saturation, 
stability. 


I.  Introduction 

DYNAMICAL  systems  with  saturation  nonlinearities  arise 
frequently  in  neural  networks,  analog  circuits,  and  control 
systems  (see,  for  example,  [2],  [4],  [5],  and  [8]  and  the  refer¬ 
ences  therein).  In  this  paper,  we  consider  the  systems  of  the  fol¬ 
lowing  form: 


x  —  cr(Ax ),  x  e  Rn  (1) 

(inhere  cr:  Rn  — >  Rn  is  the  standard  saturation  function.  With  a 
slight  abuse  of  notation,  we  use  the  same  symbol  to  denote  both 
the  vector  saturation  function  and  the  scalar  saturation  function, 
i.e.,  if  v  E  Rn ,  then  a(y)  =  [cr^),  a(v 2),  *  •  * ,  cr(vn)]T  and 

(  -1,  if  ^  <  -1 

<?(yi)  =  lvu  if-l<Vi  <  1,  (2) 

1 1  if  Vi  >  1. 

Systems  of  the  form  (1)  and  their  discrete  counterparts  mainly 
arise  in  neural  networks  and  in  digital  filters. 

As  with  any  dynamical  system,  stability  of  these  systems  is 
of  primary  concern  and  has  been  heavily  studied  in  the  literature 
for  a  longperiod  of  time  (see,  for  example,  [1],  [6],  [7],  [8],  and 
[10]  and  the  references  therein).  As  seen  in  the  literature,  the 
stability  analysis  of  such  systems  are  highly  nontrivial.  Even  for 
the  planar  case,  only  sufficient  conditions  for  global  asymptotic 
stability  are  available  [1],  [8],  [10].  In  this  paper,  we  present 
a  complete  analysis  of  the  planar  system  of  the  form  (1).  In 
particular,  necessary  and  sufficient  conditions  for  the  system  to 
be  globally  asymptotically  stable  (GAS)  or  to  have  a  limit  circle 
are  explicitly  given  in  terms  of  the  entries  of  the  matrix  A.  We 
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will  also  describe  a  surprising,  but  appealing,  phenomenon  that 
even  with  an  unstable  matrix  A  it  is  still  possible  for  the  system 
to  have  a  bounded  global  attractor. 

We  would  like  to  point  out  that  the  necessary  and  sufficient 
conditions  for  planar  linear  systems  operating  on  the  unit  square 
to  be  GAS  were  recently  identified  in  [8]  and  [9].  The  class 
of  linear  systems  operating  on  the  unit  square  can  be  put  in  a 
form  similar  to  (1)  with  cr  being  a  state-dependent  function  that 
takes  zero  value  instead  of  ±1  as  the  saturation  function  does, 
whenever  the  state  is  to  leave  the  unit  square.  By  forcing  the  state 
within  the  unit  square,  the  dynamical  behavior  is  completely 
different.  For  example,  the  closed  trajectory  would  not  exist  [9]. 

We  will  begin  searching  for  the  necessary  and  sufficient  con¬ 
dition  for  the  system  to  be  GAS  by  drawing  a  general  picture 
of  the  vector  field  in  Section  III.  Some  constants  are  captured 
to  characterize  the  vector  field.  In  Section  IV,  we  show  that  it 
is  these  constants,  rather  than  the  stability  of  the  A  matrix,  that 
determine  the  global  boundedness  of  the  trajectories.  An  inter¬ 
esting  example  is  presented  to  show  that  even  if  A  is  unstable, 
the  system  can  still  have  a  bounded  global  attractor. 

The  condition  for  the  existence  of  a  bounded  global  attractor 
as  given  in  Section  IV,  along  with  the  stability  of  the  matrix  A, 
guarantees  the  system  to  be  GAS.  This  is  shown  in  Section  V. 
Now  that  all  the  trajectories  are  bounded,  the  only  problem  to 
be  solved  in  Section  V  is  the  nonexistence  of  a  closed  trajec¬ 
tory.  This  problem  turns  out  to  be  quite  complicated  due  to  the 
partition  of  the  vector  field  by  the  saturation.  In  the  central  unit 
square  cr(x)  =  x,  and  a  trajectory  in  this  region  follows  that 
of  a  linear  system.  Off  the  central  square,  the  sequence  of  the 
intersections  of  a  trajectory  with  a  straight  line  is  governed  by 
a  first-order  linear  time  invariant  discrete-time  system.  The  real 
complexity  arises  when  a  trajectory  traverses  between  the  cen¬ 
tral  square  and  other  regions.  We  will  approach  this  problem 
through  evolving  models  with 


A  = 


-1, 

—  ko.i2<l22i 


O  12 
022 


a\2  >  1,  k  >  1. 


In  the  primary  model  a22  =  1  and  k  -  1.  In  the  secondary 
model  a22  =  1  and  k  >  1.  In  the  third-level  model  a22  6 
(0,  1)  and  k  >  1.  The  trajectories  of  the  secondary  model  are 
very  appealing.  Inside  a  certain  ellipse  all  the  trajectories  are 
closed  and  outside  this  ellipse  all  the  trajectories  converge  to 
this  ellipse.  We  will  establish  our  main  results  by  comparing 
the  trajectories  of  the  general  model  with  those  of  a  secondary 
model,  which  in  turn  are  characterized  by  comparing  with  the 
primary  model. 
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II.  Main  Results 
Consider  the  following  system 

x  =  a{Ax ),  x  €  R2  (3) 

where  a:  R 2  — >  R 2  is  the  saturation  function,  i.e.,  if  v  €  R2, 
then  <r(v)  =  j]  and  a  is  as  defined  by  (2).  For  this  system, 
we  observe  that  its  dynamics  are  left  unchanged  under  the  state 
transformation  2  =  Tx  if  T  is  of  the  form  T  =  PS  where  P  is 
a  permutation  matrix  and  S  =  diag(±l,  ±1). 

We  assume  through  out  this  paper  that  det(A)  ^  0.  This  im¬ 
plies  that  A  is  nonsingular  and  the  system  has  a  unique  equilib¬ 
rium  point  at  the  origin.  Following  the  idea  of  [1],  let  z  =  Ax. 
The  system  (3)  is  then  transformed  into  the  following  form: 

z  —  Ax  ~  Acr(Ax)  =  Ao{z). 


Remark  2.1:  We  recall  a  recent  sufficient  condition  for 
global  asymptotic  stability  of  the  system  (4)  from  [1].  The 
results  of  [1],  tailored  to  the  special  form  of  A  in  (5),  is 
summarized  as  follows,  the  system  (4)  is  GAS  if  A  is  Hurwitz 
and  one  of  the  following  conditions  is  satisfied. 

a)  a2 2  <  0. 

b)  a22  >  0  and  an  >  ai2. 

The  fact  that  a22  >  0  and  A  is  Hurwitz  imply  that 

al2  >  0. 

In  view  of  Remark  2.1,  we  only  need  to  consider  the  case 
where  a22  >  0  and  an  <  an.  In  this  case,  the  four  parameters 
an,  ai2,  a2i,  a22  are  all  nonnegative. 

III.  The  Vector  Field 

In  this  section,  we  present  a  general  picture  of  the  following 
vector  field: 


We  see  that  the  dynamics  of  the  system  (3)  and  hence  its  stability 
properties  are  equivalent  to  those  of  the  system 

x  =  Ac r(x).  (4) 


We  will  focus  on  (4)  in  this  paper. 

Given  an  initial  state  xq ,  denote  the  trajectory  of  the  system 
(4)  that  passes  through  xo  at  t  =  0  as  #0).  Mainly,  we 
consider  the  positive  trajectory  ^(t,  xq ),  £  >  0.  However,  oc¬ 
casionally  we  use  Xq),  £  >  0  for  the  purpose  of  compar- 


f®>a. 

Sr  Definition  2. 1:  The  system  (4)  is  said  to  be  stable  at  its  equi¬ 
librium  xe  =  0  if,  for  any  e  >  0,  there  exists  a  8  >  0  such  that 
|| -0(£,  xo)\\  <  e  for  all  £  >  Oand  ||xo||  <  6.  It  is  said  to  be  GAS 
if  xe  =  0  is  a  stable  equilibrium  and  limt  00  ^(£,  #0)  =  0  for 
all  xo  €  R2.  Also,  it  is  said  to  be  locally  asymptotically  stable 
if  it  is  stable  and  limt  —  00  ,  xq )  =  0  for  xo  E  Uo,  a  neigh¬ 
borhood  of  xe  =  0. 

Obviously,  xe  —  0  is  a  locally  asymptotically  stable  equilib¬ 
rium  if  and  only  if  A  is  Hurwitz.  In  this  case,  at  least  one  of  its 
diagonal  elements  must  be  negative.  Without  loss  of  generality, 
we  assume  throughout  the  remaining  part  of  this  paper  that 


““Gil*  &12 
a22 


an  >  o,  a2i  >  0.  (5) 


Otherwise,  we  can  use  T  —  [?  J]  as  the  state  transformation 
matrix  to  make  an  >  0  or  use  T  =  [J  _?]  to  make  a2i  >  0. 

Our  main  result  in  this  paper,  presented  in  the  following  the¬ 
orem,  gives  a  complete  description  of  the  stability  properties  of 
the  system  (4)  with  A  given  in  (5).  As  explained  above,  any  Hur¬ 
witz  A  can  be  transformed  into  the  form  of  (5). 

Theorom  2. 1:  The  system  (4)  is  GAS  if  and  only  if  A  is  Hur¬ 
witz  and  one  of  the  following  conditions  is  satisfied: 

a)  a22  <  0; 

b)  a22  >  0  and  ana2i  >  ai2a22. 

^On  the  other  hand,  if  none  of  a)  and  b)  is  satisfied,  the  system 
All  have  diverging  trajectories  and  there  will  be  a  closed  trajec¬ 
tory. 

In  proving  this  main  result,  we  will  also  obtain  conditions 
under  which  all  the  trajectories  of  the  system  (4)  are  bounded. 


Xi  =  -  aucr(xi)  +  a12a(x2)  =:  fi(x), 

x2-  -  a21a(xi)  +  a22a(x2)  =:  f2(x)  (6) 


where  0  <  an  <  ai2,  a2i,  a22  >  0  and  det(A)  -/=  0.  Denote 
the  slope  of  the  trajectory  at  x  as 


rj(x)  := 


Mx) 

/iW 


The  vector  field  of  (6)  is  partitioned  into  nine  regions,  ac¬ 
cording  to  the  saturation  function,  by  two  vertical  lines  Xi  =  ±1 
and  two  horizontal  lines  x2  =  ±1  (see  Fig.  1).  In  the  central  unit 
square,  x  —  Ax. 

In  the  region  U  { x :  \xi\  <  1,  x2  >  1} 


—  —  <^11^1  +  an 
X2  =  —  a2iXi  +  a22* 


Since  an  <  «i2,  xi  >  0  in  this  region  and  the  trajectories  go 
rightward.  Also  note  that  x  is  independent  of  x2,  so  for  all  the 
points  on  a  vertical  line  xi  —  c,  |c|  <  1  in  this  region  x  is 
the  same.  Because  of  this,  if  xq  E  U  and  V;(£,  xo)  E  U  for  all 
£  E  [0,  £i],  then  with  A  >  0 


Xo  + 

'o' 

_A_ 

j  =^(*,  *o)  + 

'o' 

A 

V<  €  [C 

>,  ti 

We  call  (7)  the  vertical  shifting  property  in  the  region  U.  Specif¬ 
ically,  let  xo  =  [Zq2]  >  #02  >  1  be  a  point  on  the  line  xi  =  — 1, 
then 


*i(i)  =  e_ailt(-l)  +  —  (1  -  e-Qllt) 


x2(£)  =x02  +  /  (— a2iXi(r)  +  a22)  dr 

Jo 


=  ^02  + 


a2l(^12  +  &ll) 


a 


2 

li 


(1  -e“°11*) 


(8) 


det  A 
an 


(9) 
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-4  -3  —2  —1  0  12  3  4 

Fig.  1.  The  partion  of  the  vector  field. 


point  Xo  =  f'J1],  Xoi  >  1  on  the  line  x2  =  1  and  crosses  the 
linear  =  “1  at  a  point  x  (T)  =  [^],  xti  >  1,  thenarn— a?oi 
is  a  constant.  We  denote  this  constant  as  hi.  It  can  be  verified, 
as  with  the  the  constant  h2,  that 

hi  =  xti  “  soi 

2ai2  detA  021+^22  .  n 

- +  — 9  log - ,  if  a22  >  0 

a22  a22  a21  ”  a22  ^3^ 

if  <Z22  =  0. 

<^21 

In  the  region  R  :=  {x:  xi  >  1,  x2  <  -1} 

—an  —  ai2 
— a2i  ~  a22 

We  denote  the  constant  slope  rj(x)  in  this  region  as 


Suppose  :c(£)  remains  in  the  region  U  before  it  intersects  with 
the  line  xi  =  1  at  t  =  T  with  x(T)  =  [x*2] ,  then  by  solving 
(8)  with  aq(T)  =  1  we  get 

1  0,12  +  an 

T  =  —  log - 

On  Oi2  “  On 


and  from  (9)  with  £  =  T  we  have 

2a2i  det  A 

xT2  —  #02  “ - 2 — 


aj.2  +  an 
on  -  an 


In  the  above  derivation,  we  have  assumed  that  an  <  an-  As 
^Proposition  3.1  will  show,  au  =  ai2  automatically  ensures  the 
lypobal  asymptotic  stability  of  the  system  (4)  if  A  is  Hurwitz. 
As  expected,  the  increment  of  x2  from  t  —  0  to  t  =  T  is 
independent  of  xo2.  We  denote  this  constant  as 

2a2i  det  A  ai2 -Fan  /1AN 


h2  :=  xt2  —  ^02 


ai2  +  an 
ai2  —  an 


In  the  region  V  :=  {x:  xi  >  1,  x2  >  1} 

I"  ~~an  +  ai2 

x  — 

_  —  a2i  +  a  22  ^ 

is  a  constant  So  the  slope  of  the  trajectories  is  a  constant.  We 
denote  this  constant  slope  rj(x)  as 

-a2i+a22  .... 

a:= - - - .  (11) 

—an  +  ai2 

In  the  region  W  {x:  xx  >  1,  \x2\  <  1} 

=  —  an  +  ai2£2 

x2  =  —  a2i  +  o22x2. 


In  contrast  to  the  region  U ,  x  is  independent  of  xi.  If  xq  €  W 
and  ^o)  €  W  for  all  t  €  [0,  ti],  then  with  A  >  0  we  have 

ip  x0  4-  ^  ^  aro)  +  ^ 

Wt  6  [0,  fi].  (12) 

vVe  call  (12)  the  horizontal  shifting  property  in  the  region  W.  As 
Proposition  3.1  will  show,  if  a2i  <  o22,  the  system  (4)  will  not 
be  GAS.  Now  for  the  case  that  a2i  >  a22>  ^2  <  0  and  x  points 
downward  in  this  region.  In  this  case,  if  a  trajectory  starts  at  a 


0  :=  a21+°22.  (14) 

an  +  ai2 

The  remaining  four  regions  are  symmetric  to  17,  V,  W,  and  R. 
We  denote  them  as  —U,  —V7  —W,  -R. 

For  a  general  second-order  nonlinear  system  that  has  a  unique 
equilibrium  point  at  the  origin,  its  GAS  can  be  proven  if  we 
can  show  that  all  its  trajectories  are  bounded  and  there  exists  no 
closed  trajectory.  Here  we  have  some  criteria  to  determine  the 
existence  of  closed  trajectories  for  the  system  (4). 

Lemma  3.1: 

a)  Let  Q  be  a  closed  bounded  region  that  does  not  contain  the 
origin.  If  no  trajectory  leaves  Q  or  no  trajectory  enters  Q, 
then  there  will  be  a  closed  trajectory  within  Q. 

b)  Let  Q  be  a  simply  connected  region.  If  (dfi/dxi)  + 
(df2/dx2)  is  not  identically  zero  and  does  not 
change  sign  in  Q ,  there  will  be  no  closed  trajectory 
in  Q.  (Note  that  for  fi  and  f2  as  defined  by  (6), 
(dfi/dxi)  +  {df2/dx2)  exists  inside  each  region  of  the 
partition  of  the  state  space  Fig.  1.) 

Lemma  3.1  a)  is  a  simple  application  of  the 
Poincare-Bendixon  Theorem  to  the  system  (4)  and  its  time 
reversed  system  x  =  —Acr(x).  In  addition,  b)  follows  from  the 
Bendixon  Theorem.  It  can  also  be  easily  obtained  from  Green’s 
Theorem.  This  theorem  will  be  frequently  applied  in  this  paper. 

If  the  system  (4)  has  a  closed  trajectory,  say,  F,  then  T  must 
enclose  the  origin  (by  the  index  theory)  since  the  origin  is  the 
unique  equilibrium  point.  And  T  must  be  symmetric  to  the 
origin.  Since  the  vector  field  is  symmetric  to  the  origin,  -T  is 
also  a  closed  trajectory.  If  F  is  not  symmetric,  then  F  ^  —  F 
and  the  two  different  trajectories  will  have  intersections.  This 
is  impossible  since  no  trajectories  can  intersect. 

We  next  digress  to  address  two  special  cases,  au  =  ai2  and 
a2i  <  a22- 

Proposition  3.1 :  Assume  A  is  Hurwitz. 

a)  If  an  —  an,  then  the  system  (6)  is  GAS. 

b)  If  a2i  <  a22  (which  implies  that  an  ^  ai2),  then  the 
system  has  diverging  trajectories  and  also  has  a  closed 
trajectory. 

Proof: 

a)  We  see  that  a)  is  an  extension  of  b)  in  Remark  2. 1  and  can 
be  proven  by  a  method  similar  to  [1].  First  we  claim  that 
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the  vertical  strip  H  =  {a;:  |#i|  <  1}  is  an  invariant  set 
and  a  global  attractor.  Since  A  is  Hurwitz  (det  A  >  0) 

.  ^  and  an  =  012,  we  must  have  a2i  >  a22. 

On  the  line  xx  =  1,  xx  <  0  and  on  Xi  =  — 1,  xx  >  0. 
So  no  trajectory  in  H  points  out  of  it  and  hence  it  is  an 
invariant  set.  In  the  region  V9xx  =  0,  £2  =  —021+022  < 
0,  so  all  the  trajectories  in  this  region  will  enter  W.  In 
W,  ±1  <  0,  £2  <  0,  so  all  the  trajectories  will  enter  the 
central  square  or  the  region  R.  In  R,  xx  =  —an  —  012  < 
0,  ±2  =  —021  —  022  <  0,  so  all  the  trajectories  will  enter 
the  region  —17.  Similar  arguments  apply  to  the  regions 
— V,  —W7  —R.  This  shows  that  all  the  trajectories  outside 
of  the  strip  H  will  enter  it.  Hence,  it  is  a  global  attractor. 

Next  we  show  that  all  the  trajectories  in  H  are  bounded. 
Let  pi  =  [“£],  h  >  1  be  a  point  on  the  line  xx  =  — 1. 
Then  rj(px)  =  /?  >  0.  In  the  region  U,  rj(x)  depends 
only  on  xi  and  it  can  be  easily  verified  that  rj(x)  is  a 
decreasing  function  of  xx  and  xx  >  0  for  xx  G  [—1,  1). 
So  if  we  draw  a  straight  line  E  with  slope  /?  at  px ,  then  no 
trajectory  in  U  will  cross  E  upward.  Symmetrically,  no 
trajectory  will  cross  —  E  downward.  This  shows  that  the 
parallelogram  enclosed  by  E,  — P  and^i  =  ±1,  denoted 
as  P,  is  also  an  invariant  set  and  xo)  £  P  for  all 
t  >  0  as  long  as  xq  €  P.  Since  for  every  xq  €  U  there 
exists  such  a  parallelogram  that  encloses  xq,  it  follows 
that  all  the  trajectories  are  bounded. 

InP,  ( dfi/dxi)+(df2/dx2 )  <  0(-  -an  in U,  - U 
or  —an  +  a22  in  the  central  square)  so  by  Lemma  3.1b), 
there  exists  no  closed  trajectory  in  H .  Since  H  is  a  global 
attractor,  all  the  trajectories  will  enter  it  and  then  converge 
to  the  origin.  Thus,  the  system  is  GAS. 
b)  From  0  <  a2i  <  a22  we  have  022  >  0,  otherwise 
det(A)  =  0.  We  also  have  a  >  0,  ||ir||  >  0,  and  Lx  e 
[0,  7r/2]  in  the  region  V.  So  every  trajectory  starting  from 
within  this  region  will  diverge  along  a  straight  line  with 
slope  a  and  is  unbounded.  Let  Qx  be  the  polygon  with 
vertices  1,  2,**-,  8  (see  Fig.  2,  where  at  point  2  x  = 
[a21fa22]  and  the  line  from  3  to  4  has  slope  /?).  From  2 
to  3  x2  =  0  and  xx  >  0.  From  3  to  4 ,  Lx  >  tan-1  /?  —  7T, 
so  the  trajectories  direct  outward  from  Qx.  It  is  also  easy 
to  see  that  on  other  parts  of  the  boundary  of  Q 1,  all  the 
trajectories  remain  on  it  or  direct  outward  from  it.  Since 
A  is  Hurwitz,  there  exists  a  Lyapunov  level  set  Qo  in  the 
central  square  such  that  all  the  trajectories  inside  Qo  will 
stay  inside  and  converge  to  the  origin.  Let  Q  =  Qx  \  Qo, 
then  no  trajectory  will  enter  Q,  so  by  Lemma  3.1,  there  is 
a  closed  trajectory  in  Q.  □ 

Now  that  the  two  special  cases  are  cleared,  we  now  turn  to  the 
remaining  case  where  axx  <  ax2  and  a2i  >  a22-  For  this  case, 
all  the  trajectories  go  clockwise,  see  Fig.  1  for  some  typical  tra¬ 
jectories.  Here  we  summarize  the  properties  of  the  trajectories 
as  follows. 

In  the  region  U,xx  >  0  and  the  trajectories  go  rightward.  If 
y  <  CL22/a2Xyx2  >  Oandifxi  >  a22/ (121^2  <  0.  On  the  line 
xx  =  a22/a2X,  the  trajectories  turn  from  upward  to  downward. 

In  the  region  W ,  x2  <  0  and  the  trajectories  go  downward. 
On  the  line  x2  =  axx/ax2)  the  trajectories  turn  from  rightward 
to  leftward. 


Fig.  2.  Illustration  for  the  proof  of  Proposition  3.1. 


In  the  region  V,  the  trajectories  are  straight  lines  that  go 
downward-rightward;  In  the  region  R ,  the  trajectories  go  down- 
ward-leftward. 

In  the  central  square,  on  the  line  x2  =  ( aXi/aX2)xx ,  =  0 

and  on  the  line  x2  =  ^22/021)^1,  ^2  =  0. 

Finally,  in  this  case,  hx,  h2)  a  and  j3  are  all  well  defined. 


IV.  Conditions  for  the  Global  Boundedness 
of  the  Trajectories 

In  this  section,  we  consider  the  system 


x  =  Aa(x)  = 


-an 

&21 


G12 

<*22 


Gil,  &2l,  a12  >  0, 


a(x) 
a22  >  0. 


(15) 


Assume  that  axx  <  a12  and  a2i  >  a22  (this  implies  det(A)  ^ 
0.)  We  do  not  assume  that  A  is  Hurwitz  in  this  section  since 
the  critical  case  where  A  has  a  pair  of  pure  imaginary  eigen¬ 
values  will  be  useful  to  our  study.  It  turns  out  that  the  system 
can  have  a  bounded  global  attractor,  even  if  A  is  unstable.  The 
global  boundedness  depends  on  ft/ a,  hx  and  h2>  rather  than  the 
stability  of  A. 

Proposition  4.1 :  Assume  axx  <  aX2  and  021  >  022-  The 
system  (15)  has  a  bounded  global  attractor  if  and  only  if  one  of 
the  following  conditions  is  satisfied. 

a)  ana2i  >  ax2a22. 

b)  ana2i  =  ai2a22  and  (3hx  +  h2  <  0. 

If  ana2i  =  012022  and  (3hx  +  h2  =  0,  then  outside  certain 
region,  all  the  trajectories  are  closed.  If  axxa2x  <  ax2a22  (  or 
011021  =  012022  and  fihx  +  h2  >  0),  there  will  be  unbounded 
trajectories  and  if,  in  addition,  A  is  Hurwitz,  there  exists  a 
closed  trajectory. 

Proof:  Under  the  assumption  that  axx  <  aX2  and  021  > 
a22,  we  have  a  <  0,  /?  >  0,  \hx\,  \h2\  <  00. 

Let 


Pi 


1 

uk  +  1 


Uk  >  max 


(°-i 


(J3hi  +  h2) ,  ahx 


be  a  point  on  the  line  xx  —  1.  See  the  point  labeled  1  in  Fig.  3. 
Let  the  trajectory  starting  from  px  be  px).  We  will  show 
later  that  ^{t,  px)  will  go  through  regions  V,  Wy  P,  and  —U 
consecutively  (not  fall  into  the  central  square  before  leaving 


502 


IEEE  TRANSACTIONS  ON  CIRCUITS  AND  SYSTEMS— I:  FUNDAMENTAL  THEORY  APPLICATIONS,  VOL.  47,  NO.  4,  APRIL  2000 


— U),  Let  the  intersections  of  ^(t,  pi)  with  the  lines  x2  = 
1,  X2  =  — 1,  =  1,  Xi  =  -1  be 


1  +  Ufc 

1  +Wk 

1 

and 

-i 

1 

-1  J  ’ 

1  —  ffc  _ 

_-i 

which  correspond  to  the  points  2, 3, 4,  5  in  Fig.  3.  Then 


and  uk- j-i 


1 

vk= - uk 

a 

_  1 

=  'Ufc  +  — - Uk  4  m 

a 

rk  =  / 3wk  = - uk  +/?/ii 

a 


rfc  +  ft2,  i.e., 


Ufc+i  =  — w*;  4  /3/ii  4  h  2- 
a 


(16) 


The  requirement  that  the  trajectory  does  not  enter  the  central 
square  is  equivalent  to  vk,  r*,  Uk+i  >  0.  This  can  be  guar¬ 
anteed  by  uk  >  max  (0,  {a/p)  (/ %i  4  ^2)  >  ahi).  If  we  also 
have  Wfc+i  >  max  (0,  (a/0)  (0hi  -I-  h2) ,  ahi),  then  we  can 
continue  with  the  above  process  symmetrically  to  get  an  inter¬ 
section  with  the  line  Xi  =  1,  j^+ifc+2  j  (point  9  in  Fig.  3)  where 


^fc+2  = - +  Phi  4  h2 

a 

and  so  on.  Equation  (16)  defines  a  first-order  linear  time  in¬ 
variant  discrete-time  system. 

Case  1  (aua2 1  <  ai2a22J:  This  inequality  is 

equivalent  to  -(/3/a)  >  1.  So  in  this  case,  the 

discrete-time  system  (16)  is  unstable.  If  Uk  > 

max  (0,  (a/(a  4  0))  ( Phi  4-  h2) ,  (a/0)  (ph±  4  h2) ,  ahi), 
then  uk+i  >  Uk ,  Uk+ 2  >  uk+ 1,  *  *  *  will  be  an  exponentially 
increasing  sequence  and  the  trajectory  starting  from  [Uk+i\ 
will  be  unbounded. 

Let  pi  =  [i+uJ  where  ux  > 

max  (0,  (a/(a  +  /?))  {fihi  +  h2) ,  (a/P)  (Phi  +  h2) ,  ahi) 
jee  point  1  in  Fig.  4).  Then  by  the  foregoing  argument, 
yj(t,  pi)  will  return  to  the  line  x\  =  1  at  a  point  above  pi  (see 
2  in  Fig.  4).  By  connecting  1  and  2,  we  get  a  closed  curve.  Let 
the  region  enclosed  by  this  closed  curve  be  Qi-  From  1  to  2,  x 
is  a  constant  and  Lx  e  ( — (7t/2),  0)  since  a  <  0.  So  x  directs 


outward  from  Qi.  If  A  is  Hurwitz,  there  will  be  a  Lyapunov 
level  set  Qo  in  the  central  square  which  is  invariant.  Let 
Q  =  Ql\  Q0i  then  no  trajectory  will  enter  Q  and,  by  Lemma 
3.1,  there  is  a  closed  trajectory  in  Q  as  illustrated  in  Fig.  4. 

Case  2  (ana2i  >  This  inequality  is  equivalent  to 

-(P/a)  <1.  Since  -( p/a )  >  0,  in  this  case  the  discrete-time 
system  (16)  is  stable.  Let  u*  be  chosen  such  that 


min 


in  —  u*  4/?/u  4  h2, 

>  max  ^0,  ^  (Ph±  4  h2) ,  ah^j 


(17) 


and 


vr  4 


H4 


i  4  h2)  <  —1  (18) 


then  with  uk  >  u*,  the  trajectory  ^(t,  [Ufc+i])  does  not  fall  into 
the  central  square  before  it  returns  to  the  line  xi  =  1  (This  is 
guaranteed  by  (17).  Moreover,  because  of  (18),  we  have 


Uk+ 2  “  Uk  = 


< 

< 


((a)  -1)  uk+(l-^j{(ihi+h2) 

((s)2-i),r+(i-9a*ki+*f) 

-  I-  (19) 


Let  pi  =  [i+u*]  (see  point  1  in  Fig.  5).  Then  by  the  foregoing 
argument,  ^(t,  pi)  will  return  to  the  line  xi  =  1  at  a  point 
2  between  pi  and  [\].  By  connecting  1  and  2,  we  get  a  closed 
curve.  Denote  the  region  enclosed  by  this  closed  curve  as  Qi . 
Since  on  the  line  between  1  and  2  x  directs  inward  of  Q\ .  Thus, 
xq)  will  stay  in  Qi  as  long  as  xo  €  Q±.  Therefore,  Qi  is 
an  invariant  set. 

Let  xq  be  any  point  outside  of  Qi,  then  ^(t,  so)  goes  clock¬ 
wise  and  will  intersect  with  the  line  xi  =  1  above  2,  say  at 
p  =  [i+Uo] .  If  uo  <  it*,  i.e.,  p  is  between  1  and  2,  then  x0) 
will  enter  Qi  afterward  and  stay  there.  If  u0  >  u*,  then  by  (19), 
we  have  u2  <  uq  —  1,  u±  <  u2  —  1,  ■  •  •  until  uk  <  u*  for 
some  finite  k.  This  implies  ^(ti,  xo)  £  Qi  for  some  ti  >  0. 
Therefore,  Qi  is  a  global  attractor. 
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Fig.  5.  Illustration  for  the  Proof  of  Proposition  4. 1 :  Case  2.  Fig.  6.  A  global  attractor. 


Case  3  oua21  =  a12a22:  In  this  case,  -(/5/a)  =  1  and  Consider  the  time-reversed  system  of  (20), 


Uk+2  ~Uk—  +  h2). 

Suppose  phi  +  h2  <  0,  the  sequence  Uk ,  Uk+ 2,  •  •  •  will  de¬ 
crease  steadily  before  the  trajectory  touches  the  central  square, 
similar  to  Case  2,  there  exists  a  global  attractor. 

Suppose  phi  +  h2  >  0,  the  sequence  will  increase  steadily 
and  the  trajectory  will  go  unbounded.  Also,  similarly  to  Case  2, 
there  exists  a  closed  trajectory. 

Suppose  phi  +  h2  =  0,  then  if 

%.  >  max  (0,  (a//?)  (/3/ti  +  ^2) >  a/ii),  we  will 

rave  Uk  =  Ufc+i  =*=  for  all  AT.  So  [i+Uk]  is  on  a 
closed  trajectory.  Let  Qi  be  the  region  enclosed  by  the  closed 
trajectory  passing  through  [i+^J,  then  all  the  trajectories 
outside  of  Qi  are  closed.  □. 

To  demonstrate  Proposition  4.1,  consider  the  system  with 
A  —  [I5  |]  *  Clearly,  A  is  exponentially  unstable,  but  ana2i  > 
«i2^22-  So  the  system  has  a  global  attractor  (see  Fig.  6). 

An  interesting  case  is  that  an  =  022  and  <221  =  aX2.  In  this 
case,  A  has  a  pair  of  pure  imaginary  eigenvalues.  For  the  linear 
system  x  =  Ax  every  point  in  the  plane  is  on  a  closed  trajectory. 
This  is  also  true  for  the  saturated  system 

x  —  Acr{x)  =  au  ai2  cr{x),  ai2  >  an  >  0.  (20) 
L~ai2  an] 


z  —  —  Aa(z).  (21) 

Denote  its  trajectory  as  <f>(t ,  xo).  Then  xo)  —  xo). 

From  (21),  we  have 

Jz  =  —  JAcr(z)  =  —JAJa(Jz)  =  Acr(Jz) 

thus,  rro)  =  ^1  (t,  Jx 0).  Since  Jx0  =  x0,  it  follows  that 
x0)  =  xo ). 

To  show  that  the  trajectory  is  symmetric  with  respect  to  x\  — 
—X2,  we  write  (20)  as 


—an  -ai2 
ai2  an 


=  At 


cr(xi) 
cr(-x 2)m  ’ 


<r(x  1) 


We  also  have  -  JAT  J  =  AT.  Following  the  same  procedure 
as  above  by  considering  the  state  [*lxJ  instead,  we  can  show 
that  all  the  trajectories  are  symmetric  with  respect  to  the  line 

X\  =  —x2.  □ 

The  system  (20)  is  not  GAS  but  is  useful  for  us  to  develop  the 
condition  for  global  asymptotic  stability.  We  will  establish  the 
main  result  of  the  paper  by  comparing  the  trajectory  of  a  general 
system  with  that  of  (20). 


Denote  the  trajectory  of  (20)  as  ipi (i,  #0). 

Proposition  4.2:  All  the  trajectories  of  (20)  are  closed.  Each 
trajectory  is  symmetric  with  respect  to  the  line  xi  —  x2  and  the 
line  xi  =  —x2. 

Proof:  For  this  system,  ana 21  =  012022  and  it  can  also 
be  verified  that  phi  +  h2  =  0.  By  Proposition  4.1,  Vt  (£,  £0)  is 
bounded  for  every  xq.  On  the  other  hand,  since  A  has  a  pair  of 
pure  imaginary  eigenvalues,  there  are  closed  trajectories  in  any 
neighborhood  of  the  origin.  Thus,  any  Xo  is  outside  of  a  closed 
trajectory.  Therefore,  'ipi(t}  x0)  will  be  a  closed  curve  or  go  to 
'closed  curve.  Since  ipi (t,  xo)  goes  clockwise,  it  will  intersect 
the  line  Xi  =  x2  somewhere,  say,  at  [J!].  So,  for  simplicity,  we 
can  assume  that  x0  —  [£]  for  some  r  >  0.  To  show  ^1  (t ,  x0)  is  a 
closed  trajectory  and  is  symmetric  to  the  line  xi=  x2,  it  suffices 
to  show  that  #0)  =  £0)  where  J  =  [J  J]  • 


V.  Proof  of  Theorem  2.1 

In  view  of  Remark  2.1  and  Proposition  3.1,  we  only  need  to 
consider  the  following  system: 

x=A<r{x)  =  [_an  ai2l  <r(x) 

[~a2i  a22  J 

a>iu  ai2,  a2i  >  0,  a22  >  0  (22) 

with  ai2  >  an,  a2i  >  022- 

Proposition  5.1:  Assume  that  ai2  >  an  and  A  is  Hurwitz, 
the  system  (22)  is  GAS  if  and  only  if  aua2i  >  012022- 

This  proposition  can  be  established  as  follows.  First  note  that 
012  >  an  andana2i  ^  03.2022  imply  021  >  022-  Ifana2i  = 
ai2a22  and  A  is  Hurwitz,  then  it  can  be  verified  that  phi  + 
h2  <  0.  Hence,  this  proposition  shows  that  the  stability  of  A 
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along  with  the  global  boundedness  condition  in  Proposition  4. 1 
guarantees  the  system  to  be  GAS. 

,  If  ana 21  <  ai2a22,  then  by  Propositions  3.1  and  4.1,  the 
system  is  not  GAS  whether  a2i  >  a22  or  not.  So  the  necessity 
of  the  condition  is  obvious.  What  remains  is  to  show  the  suffi¬ 
ciency  of  the  condition.  Now  that  the  global  boundedness  of  the 
trajectories  is  guaranteed,  the  only  thing  needed  to  be  shown  is 
that  the  system  has  no  closed  trajectory. 

Since  all  the  trajectories  are  kept  unchanged  when  the  vector 
field  is  multiplied  by  a  positive  constant,  we  assume  that  an  = 
1  in  the  sequel  for  simplicity.  Now  we  have 


“<221  <*22 


We  first  deal  with  the  case  where  a22  =  0. 

Lemma  5.1:  Assume  ai2  >  an  and  A  is  Hurwitz.  If  a22  = 
0,  then  (22)  is  GAS. 

Proof:  See  the  Appendix.  □ 

In  what  follows,  we  consider  the  case  that  a22  >  0.  Let  k  = 
a2i/ax2a22,  then  we  can  assume  that  A  takes  the  form 

<»> 

The  assumption  in  Proposition  5.1  that  an  <  ai2  and  A  is 
Hurwitz  translates  to 

ai2  >  1,  a22  <  1,  ka^  >  1 

and  the  condition  an<*2i  >  ax2a22  is  equivalent  to 

k  >  1. 


Now  we  consider  the  case  where  a22  =  1  and  k  >  1, 


x  — 


“1  0,12 

—ka\2  1 


cr(rc),  an  >1,  k  >  1. 


(25) 


Given  an  initial  point  x0,  denote  the  trajectory  of  (25)  as 
ip2{t>  x0)  and  as  a  comparison,  denote  the  trajectory  of 


x ; 


-1  ax2 
— ai2  1 


cr(x) 


(26) 


as  fa (t,  a?o)-  Then  i/jft,  a:o)  is  closed  for  every  x0  by  Proposi¬ 
tion  4.2. 

In  the  following,  we  present  three  lemmas  about  the  intersec¬ 
tions  of  xq)  with  some  straight  lines. 

Lemma  5.3:  Assume  k  >  1. 

a)  Let  xo  =  ft01].  If  x01  €  (l/a12,  1],  then  ip2(t,  x0)  (see 
the  dashed  curve  in  Fig.  7)  may  intersect  with  the  line 
Xi  =  1.  Let  the  first  intersection  be  xc  =  [xe2],  then 
Xc2  <  Xoi,  i-ej 


'1' 

< 

’ll 

Xo  ” 

ft 

xc 

l\ 

If  Xoi  e  [l/fca12,  l/ai2],  (t,  Xo)  will  go  downward- 

rightward  at  first,  but  will  not  intersect  with  the  line  = 
1  before  it  turns  leftward  (see  the  dotted  curve  in  Fig.  7). 
b)  Let  x0  =  yj  ,  x02  <  l/o12.  Then  ip2(t,  ®o)  goes 
downward-leftward  (see  the  dash-dotted  curve  in  Fig.  7). 
Let  the  first  intersection  of  ip2(t,  ^o)  with  the  line  X2  = 
-1  be  xc  =  ft^1] ,  then  £02  >  ~xcu  i.e., 


l' 

ll 

Xq  — 

> 

^-lj 

Therefore,  we  can  establish  Proposition  5. 1  by  showing  that  the 
system 


x  ~  Aa(x)  = 


cr(x) 


—1  ax2 

~fcax2a22  a22 
ai2  >  1,  k  >  1,  0  <  a22  <  1 


(24) 


is  GAS.  The  proof  will  be  carried  out  by  evolving  A  from  the 
simplest  form  where  a22  =  1,  k  =  1  to  the  case  a22  =  1,  k  >  1 
and  finally  to  the  general  case  0  <  a22  <  1,  k  >  1,  When 
a22  =  1,  the  system  is  surely  not  GAS  because  A  is  not  Hurwitz, 
but  the  trajectories  in  this  case  will  be  used  as  a  reference  to 
show  the  convergence  of  the  trajectories  when  a22  is  decreased. 

To  proceed,  we  need  a  technical  lemma.  Recall  (13) 


hi 


f  2ax2  det  A  a2i  +  a22 

- +  —5—  log - , 

a22  a22  a2i  —  a22 

2au 

-  <*21  ’ 


if  a22  >  0 


if  a22  =  0. 


Now  we  have  a22  >  0  and  a2i  =  kai2a22>  so 

j  hi=^  (_2ai2 + (fca'2 " 1}  log  • 

Lemma  5.2:  If  a22  >  0,  ai2  >  1  and  k  >  1,  then  hi  <  0. 
Proof:  See  the  Appendix.  □ 


As  a  comparison,  two  ip  1  (t,  so)  are  also  shown  in  Fig.  7  (see 
the  solid  curves).  In  Fig.  7,  so’s  are  marked  with  *. 

Proof:  See  the  Appendix.  □ 

Lemma  5.4:  Given  7  >  0,  let  xo  =  f1*7]  ,  si  6  (l/ax2,  1] 
be  a  point  on  the  line  x\  =  1  +  7.  Then  ij)2 (£,  xq)  will  go 
downward-rightward  at  first,  then  turn  leftward  and  return  to 
the  line  Xi  =  1  +  7.  Let  the  intersection  be  xc  =  f1*7],  then 

Si  +  S2  >  0. 

Proof:  See  the  Appendix.  □ 

Lemma  5.5:  Let  xq  =  [ft1] ,  s0x  >  l/fca12  be  a  point  on  the 
line  x2  —  1.  Then  i/j, 2  (t,  so)  goes  downward-rightward  at  first 
and  turns  leftward.  Suppose  ip2(t,  ar0)  has  an  intersection  with 
the  line  x2  =  -1  at  xc  —  [ft1  ] ,  then  xci  <  xoi  (see  Fig.  8). 

Proof:  See  the  Appendix 

The  following  two  lemmas  give  a  complete  characterization 
of  the  trajectories  of  the  system  (25). 

Lemma  5.6:  Assume  k  >  1.  Let  x*  =  Then, 

ip2{t,  x*)  is  a  closed  curve  that  lies  within  the  central  square. 
Denote  the  region  enclosed  by  ip2(t,  x*)  as  S0,  then  every  point 
inside  So  is  on  a  closed  trajectory.  And  outside  So,  any  trajec¬ 
tory  will  converge  to  ip 2(£,  x*)  (see  Fig.  9). 

Proof:  See  the  Appendix.  □ 

Lemma  5.7:  Assume  k  >  1.  Let  xo  =  [ft1] ,  #01  <  l/kai2 
be  a  point  on  the  line  x2  =  l,then^2(*>  20)  goes  upward  at  first 
and  will  return  to  the  line  x2  =  1.  Suppose  ip2(t,  xq)  intersects 
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Fig.  8.  Illustration  for  Lemma  5.5. 


-2  -1.5  -1  -0.5  0  0.5  1  1.5  2  2.5 


Fig.  9.  Illustration  for  Lemma  5.6. 

with  the  line  x2  =  —1.  Let  xc  =  [xl\]  be  the  first  intersection, 
then  — (l/fcai2)  <  xci  <  -xqx. 

Proof:  See  the  Appendix.  □ 

Lemmas  5.6  and  5.7  give  us  a  clear  picture  of  the  trajectories 
of  (25),  where  a2 2  =  1,  k  >  1.  Lemma  5.7  shows  that  if  xq  is 
utside  of  So,  a  trajectory  ^2  (t,  #0)  will  move  closer  and  closer 
4.6  So  as  it  reaches  the  lines  x2  =  dbl.  Next  we  will  show  that  as 
do 2  is  decreased,  a  trajectory  ^(t,  xq)  of  (24)  will  move  even 
closer  to  £0,  as  compared  with  V;2(f,  ^o)-  This  will  lead  to  our 
final  result  about  the  global  asymptotic  stability  of  the  system 


(24)  and  hence  the  proof  of  Proposition  5.1.  Rewrite  (24)  as 
follows: 

xx  =  -  cr(x  1)  -f  ai2cr(x2) 

x2  =  <*22  {—kai2v{xi)  +  0^2))  (27) 

where  ai2  >  1,  k  >  1  and  0  <  a22  <  1.  We  will  consider  the 
perturbation  of  the  trajectories  as  a22  is  varied,  so  denote  the 
trajectory  of  (27)  as  xo,  a22 )  and  the  slope  of  a  trajectory 
at  x  be  77(0;,  a22).  As  compared  with  (25),  x\  is  the  same  but  x2 
is  multiplied  with  a  scalar  a22.  Because  of  this,  the  trajectories 
of  (27)  exhibit  some  interesting  properties. 

Fact  5.1: 

a)  Letxo  =  [*£*] ,  x02  >  1  be  a  point  above  the  line  x2  =  1, 
then  for  all  a22  >  0 

[0  l]fj>(t,  x0i  a22)-x02  =  a,22  ([0  1]^2(*,  xq)  —  X02) 


[1  x0,  a22)  =  [1  0]i/j2(t,xo) 

as  long  as  xo ,  a22)  stays  above  the  line  x2  =  1. 

b)  Let  xo  =  [%ll]  ,  xoi  >  1  be  a  point  to  the  right  of  the  line 

Xi  =  1,  then  for  all  a22  >  0 

[1  0 Xq,  CL22)-Xoi 

=  -  ([1  O]'02(a22t,  Xq)  -Xqi) 

0>22 

[0  Xo,  a22)  =  [0  l]^2{o22f  xq) 

as  long  as  xo,  a22)  stays  to  the  right  of  x\  —  1. 

See  Fig.  10  for  an  illustration,  where  the  solid  curves 
are  t)j2  (t,  #o)  and  ^2(a22i,  xo),  and  the  dashed  curves  are 
i>(t,  x0,  a22),  a22  <  1. 

Fact5.1a)  implies  that  ^(t,  xo,  a22)  and  ^2 (t,  £0)  are  on 
the  same  vertical  line  but  the  distance  from  xq ,  a22)  to 
the  line  x2  =  X02  is  a22  times  that  from  ^2 (t,  xo)  to  x2  =  #02. 
In  particular,  i>2 (£,  xo)  ^  o22)  return  to  the  line 

x2  =  X02  at  the  same  time  and  the  same  point.  This  simply 
follows  from  the  fact  that  x2  of  (27)  is  a22  times  that  of  (25) 
and  that  x  is  independent  of  x2  above  the  line  x2  ~  1.  It  can 
also  be  directly  verified  from  the  expression  of  ^(t,  x0 ,  a22) 
and  #o)- 

Fact5.1b)  implies  that  t ,  xo,  a22)  and  ^2(^22^  #o)  are 

on  the  same  horizontal  line  but  the  distance  from  t ,  xo,  a22) 

to  the  line  x\  =  xoi  is  l/a22  times  that  from  ^2(^22^,  £0) 
to  X\  =  xoi.  In  particular,  ^2(022^,  #0)  and  xo,  a22) 
return  to  the  line  xi  =  xoi  at  the  same  time  and  the  same 
point.  This  also  follows  from  the  fact  that  x2  is  scaled  by  a22. 
If  we  scale  the  vector  field  to  the  right  of  the  line  xi  =  1  by 
l/a22,  then  x2  is  the  same  as  that  of  (25)  but  xi  is  amplified 
by  l/a22.  Note  that  the  scaling  of  the  vector  field  results  in  the 
time  scaling  of  Y;2(a22 1,  #0). 

With  Fact  5. 1,  we  are  ready  to  present  a  final  lemma  that  leads 
to  the  proof  of  Proposition  5.1. 
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Fig.  1 0.  Illustration  for  Fact  5.1 . 


Fig.  12.  Illustration  for  the  Proof  of  Proposition  5.1. 


->-5  -t  -Oi  0  0A  t  1J 


Fig.  1 1 .  Illustration  for  the  Proof  of  Proposition  5.1. 

Lemma  5.8:  Let  x0  =  ,  £02  €  (0,  1],  x0i  > 

#02/^12.  Suppose  xq ,  a22)  intersects  with  the  line 
x2  =  —  xq2  at  a  point  xc  =  [1°^02]  and  xci  <  X01,  then 
if  6  e  (0,  <222)  is  sufficiently  small,  ip(t,  xo ,  022  -  5)  will 
intersect  with  xo,  022)  at  a  point  to  the  right  of  x$.  If  it 
also  intersects  with  the  line  x2  =  “2:02,  the  intersection  will 
be  to  the  left  of  xc. 

For  an  illustration  of  Lemma  5.8,  see  Figs.  16-18  where 
the  solid  curves  are  G22)  and  the  dashed  curves  are 

<*22  -  &)• 

Proof:  See  the  Appendix.  □ 

Proof  of  Proposition  5.1:  The  necessity  of  the  condition 
simply  follows  from  Propositions  3 . 1  and  4. 1 .  With  Lemma  5.1, 
it  remains  to  be  shown  that  the  system  (27)  or  (24)  is  GAS.  We 
will  first  show  that  any  point  on  the  line  £2  =  1  is  not  on  a 
closed  trajectory.  We  can  restrict  our  attention  to  the  points  to 
the  left  of  p/*ai2  9  since  for  the  points  to  its  right,  they  can  be 
traced  back  to  the  left  as  the  trajectories  go  rightward  above  the 
line  x2  =  1.  Let  xo  =  [x°i] ,  xoi  <  l/fcai2,  then  tJj 2(t,  xf)  of 
file  system  (25)  (see  the  solid  curve  in  Fig.  1 1)  will  return  to  the 
Jnex2  =  1  at  a  point  xf0.  From  Fact  5.1,  xq ,  a22)willalso 
return  to  for  all  <222  >  0  (see  the  dashed  curve  in  Fig.  11). 
We  have  shown  in  Lemma  5.7  that  for  any  xo  to  the  left  of 
reaches  the  line  x2  =  —1  at  some  point 


xc  =  [xl\] ,  then  xci  <  —  xoi,  i.e.,  xc  is  to  the  left  of  -x0. 
By  Lemma  5.5,  xc  is  also  to  the  left  of  x'0 .  From  Lemma  5.8, 
we  know  that  as  <222  is  decreased  from  1,  the  intersection  of 
Xq:  a22)  and  x2  =  *-1  will  move  leftward  and,  hence,  re¬ 
main  to  the  left  of  —  x0  andxg.  Note  thatXp  is  ony;(£,  ^22), 

so  Xq,  a22)  overlaps  with  ^(: t ,  xo,  022)*  Therefore,  xo  is 
not  on  a  closed  trajectory  (note  that  a  closed  trajectory  must  be 
symmetric). 

Next  we  exclude  the  possibility  of  the  existence  of  a  closed 
trajectory  that  does  not  intersect  with  x2  =  1.  Suppose  there  is 
one,  then  it  must  intersect  with  the  line  x2  —  ka^xi  at  some 
point,  say  x0  =  [%°0l]  ,  x02  <  1,  then  at  xo,  x2  =  0  and  x0  € 
So.  When  <222  =  1,  xo,  022)  =  ^0)  is  an  ellipse  that 

touches  the  lines  x2  =  ±xo2  (see  the  solid  curve  in  Fig.  12).  By 
Lemma  5.8,  as  a22  is  decreased  to  a22  ~  8,  xo,  a22  -  8) 
will  intersect  with  x0,  a22)  at  a  point  to  the  right  of  x0  and 
— xo.  After  that,  it  will  stay  above  xo,  a22)  and  above  the 
line  x2  =  -X02  (see  the  dashed  curves  in  Fig.  12).  Thus  no 
closed  trajectory  can  be  formed. 

If  k  >  1,  then  ana2 1  >  a12a22.  If  k  =  1,  then  ana2i  = 
ai2a22  and  it  can  be  verified  that  j3  =  a22,  fihi  +  h2  =  a22(l  - 
^22)^1  <  0  (assume  an  =  1).  So  by  Proposition  4.1,  all  the 
trajectories  of  (27)  are  bounded,  and  they  must  converge  to  the 
origin. 

Proof  of  Theorem  2.1:  Combining  Remark  2.1,  Proposi¬ 
tions  3 . 1 , 4. 1 ,  and  5. 1 ,  we  can  obtain  the  necessary  and  sufficient 
condition  for  the  system  (4)  to  be  GAS.  Condition  b)  in  Theorem 
2.1  is  a  simple  combination  of  Condition  b)  in  Remark  2.1  and 
Propositions  3.1, 4.1,  and  5.1.  This  simplification  is  justified  as 
follows. 

Since  A  is  Hurwitz  and  a22  >  0,  we  must  have  aX2  >  0. 

If  <*12  <  on.  Remark  2.1  b)  and  Proposition  3.1  say  the 
system  is  GAS.  If  oi2  >  an,  because  011021  >  oi2a22,  the 
system  is  also  GAS  by  Proposition  5.1. 

Conversely,  suppose  o22  >  0  but  ana2i  <  ai2a22,  we  have 

Ql2  «21 

an  a22 

Since  A  is  Hurwitz 

fli2 

an  a2i 
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Therefore 


i.e.,  a\2  >  an.  Hence  by  Propositions  3.1  and  4.1,  the  system 
is  not  GAS  whether  a2i  >  «22  or  not.  And  in  both  cases,  the 
system  has  unbounded  trajectories  and  there  is  also  a  closed 
trajectory.  □ 


Next  we  show  that  for  any  fixed  ai2  >  1,  hi  <  0  for  all 
k  >  1.  Here  we  have 

hi(k )  =  -2ai2  +  (ka\2  -  1)  log  * y  ■ 

We  have  just  shown  that  for  any  given  >  1,  hi(l)  <  0.  As 
k  — ►  oo,  we  also  have  hi  — >  0.  Suppose  there  is  an  extremum 
k*  between  (1,  oo),  then  dhi/dk  =  0.  This  implies 


VI.  Conclusions 

We  gave  a  complete  stability  analysis  of  a  planar  linear 
system  under  saturation.  The  analysis  involves  intricate  in¬ 
vestigation  on  the  vector  field  and  the  intersections  of  the 
trajectories  with  the  lines  xi  =  ±1  and  X2  =  ±1.  Our  main 
result  provides  a  necessary  and  sufficient  condition  for  such  a 
system  to  be  GAS. 


Appendix 
Proof  of  Lemmas 


Proof  of  Lemma  5.1 

Under  the  condition,  we  have  a2i  >  a2 2,  ana2i  >  ai2a22. 
By  Proposition  4. 1,  the  system  has  a  bounded  global  attractor. 
We  need  to  show  that  there  exists  no  closed  trajectory.  Suppose, 
on  the  contrary,  that  there  is  such  a  one.  Denote  the  region  en¬ 
closed  by  the  closed  trajectory  as  Q,  then  by  Green’s  Theorem 


dfi  dh 

dxi  8x2 


) 


dx  1  dx2 


0. 


Since  a  closed  trajectory  must  enclose  the  origin,  the  area  of 
the  intersection  of  Q  and  the  central  square  is  nonzero.  Thus, 
the  left-side  integral  is  strictly  smaller  than  zero.  Note  that 
(< dfi/dxi )  +  (df2/dx2)  =  —1  in  the  central  square  and 
nonpositive  in  other  parts  of  the  plane.  This  is  a  contradiction.^ 


Proof  of  Lemma  5.2 

We  only  need  to  show  that  the  lemma  is  true  when  a22  =  1. 
First,  let  k  =  1,  then 

hi(a12)  =  -2ax2  +  (a?2  ~  l)  log  —  - (28) 

ai2  —  -L 

As  ai2  — >  1,  hi  — +  —2  and  as  ai2  oo,  hi  — »  0.  Suppose 
there  is  an  extremum  a*2  in  the  interval  (1,  oo),  then  at  this  ex¬ 
tremum  dhi/dai2  =  0.  From  routine  computation,  this  implies 

1 _ a12  +  1  2 

log  - - 7  =  — • 

a12  a12 

Put  this  into  the  formula  (28),  we  get  the  only  possible  extremum 
value 

)  hi (a*2)  =  “""7“  <  0* 

a12 


log 


k*  q,x 2  +  1  2  2  ~  l) 

fc*ai2  —  1  ai2  (k*ax2  —  1)  (h*a  X2  +  1)  * 


Put  this  into  the  function  hx(k)9  we  get 


h  (k*\  —  2qi2  +  2  -  4fc*a^2  n 

U  }  ai2(fc*ax2-l)(fc*a12  +  l)  < 


(note  that  ai2  >  1,  k  >  1).  It  follows  that  hx(k)  <  0  for  all 
k  >  1  and  ai2  >  1.  □ 


Proof  of  Lemma  5.3 

a)  This  can  be  shown  by  comparing  *02  #o)  with 

^i(t,  Xo).  Since  ^i(t,  #o)  is  symmetric  with  respect  to 
the  line  xi  —  x2,  it  will  intersect  with  Xi  =  1  at  [XJJ 
for  any  xoi  6  [l/ai2,  1].  Since  at  the  same  point  x,  if 
xi  >  0,  then  x2  of  (25)  is  smaller  (more  negative)  than 
that  of  (26)  and  xx  of  the  two  is  the  same,  so  %o) 
is  below  i>x(t,  xq).  Hence,  the  first  intersection  of 
02  %o)  with  xi  =  1,  if  there  is  one,  must  be  below  that 

of  ipi  (t}  xo)  with  xx  =  1,  which  is  LH .  This  shows 

that  |h  -  [1]  ||  <  ||*e-  [i]||. 

If  xoi  €  [l/^ai2,  l/ai2],  02  a?o)  will  go  down- 
ward-rightward  at  first  and  when  it  reaches  the  line 
xi  =  l/aL2,  it  is  below  the  point  Since 

0i  (t,  1iai2])  does  not  go  beyond  the  line  xx  =  1 

(at  the  intersection  x\  —  0),  02(J,  xo)  will  not  intersect 
with  the  line  before  it  turns  leftward. 

b)  If  a;o2  <  l/ai2,  then  02(t,  #o)  goes  downward-leftward. 
Suppose  02(t,  ^o)  intersects  withx2  =  —1  ata;c.  Let  the 
region  enclosed  by  02(£,  #o)  and  the  two  lines  xx  =  1, 
X2  =  —  1  be  5,  then  by  Green’s  Theorem 


f  /2(®)  dxi  -  fi(x)  dx2 
Jos 

- fl 


5 
=  0 


where  dS  denotes  the  boundary  of  5  that  goes  clockwise. 
Note  that  along  the  trajectory  02 #0),  the  integral  on  the 
boundary  is  zero,  so  we  have 


Since  hx  <  0  at  the  two  end  points  of  the  interval  (1,  00),  we 
must  have  hi  <  0  on  the  whole  interval. 


T<- 


1  +  ai2^2)  dx 2  + 


l  <- 


kaX2X  1  -  1)  dx  1  =  0. 
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Let 


c  — 


xc 


Xq 


1 

-1 

1 

-1 


=  1-Xci 
=  #02  +  1 


then  from  the  above  equation 


kdi2 


c2  -  (1  +  fcai2)  c  —  —  e2  -  (1  +  ai2)  e. 


(29) 


Since  faity  #o)  intersects  with  x2  =  “1  downward,  so 
at  xc  we  must  have  #2  <  0.  This  implies  xc  must  be  to 
the  right  of  i.e.,  c  <  1  +  l/kai2.  Similarly, 

e  <  1  +  l/ai2.  It  can  be  shown  by  the  manipulation  of 
quadratic  functions  that  for  any  e  <  1  +  l/ai2  there  is  a 
unique  c  <  1  +  l/fcai2  satisfying  (29)  and  c  <  e  due  to 
k  >  1  and  ai2  >1.  □ 

Proof  of  Lemma  5.4 

Since  s\  E  (l/ai2,  1],  at  xo,  #1  >  0,  and  #2  <  0.  Thus, 
V;2(tf,  #0)  goes  downward-rightward.  In  the  region  W,  above 
the  line  x2  =  l/ai2,  #1  >  0  and  below  the  line  #1  <  0,  so 
y>2 (tj  xo)  turns  downward-leftward  on  meeting  this  line. 

By  the  horizontal  shifting  property  (12)  of  the  trajectories  in 
|he  region  W,  it  suffices  to  show  that  the  lemma  is  true  for  one 
>  0.  Choose  7  sufficiently  large  such  that  when  V>2 (t,  #0) 
reaches  the  line  x2  =  —  at  £1+Z*Aj ,  it  is  still  inside  W, 
i.e.,  7  -f*  A  >  0.  Obviously,  the  quantity  A  is  independent  of 
7  like  hi.  If  A  <  0,  then  [1+_7+A]  is  to  the  left  of  the  line 
#1  =  1  +  7.  This  implies  ^2(t,  #0)  must  have  intersected  the 
line  #1  =  1  +  7  at  [r +7]  before  it  reaches  •  Note  that 

V>2(£,  #0)  goes  downward-leftward  below  the  line  x2  =  l/ai2. 
Thus  S2  >  —siy  i.e.,  «i  +  S2  >  0. 

What  remains  to  be  shown  is  that  A  <  0  is  indeed  the  case. 
Trivial  calculation  shows  that 


A  =  —  2ai25i  +  (ka\ 2  -  l)  log 


ka>i2  $1 

kai2  —  Si 


When  si  =  1  we  get  A  =  hi.  Let  ai2  =  ai2si ,  k  —  k/s\,  then 


A  =  —  2oi2  +  (fca  12  —  l)  log 


ko>i2  “h  1 
kai2  -  1 


This  is  similar  to  hi.  Since  si  £  (l/ai2,  1],  we  have  ai2  > 
1,  k  >  1,  so  by  Lemma  5.2,  A  <  0.  □ 

Proof  of  Lemma  5.5 

When  #01  >  1  we  must  have  xc\  <  #01 , otherwise  we  would 
pt  hi  >  0.  However,  we  know  that  hi  <  0  by  Lemma  5.2. 

What  remains  to  be  shown  is  the  case  where  #01  €  (l/fcoi2,  1). 

Since  arci  depends  continuously  on  #01,  it  suffices  to  show  that 
xci  #01  for  any  #01  €  (l/fcai2,  1).  We  prove  this  by  contra¬ 
diction. 


Assume  that  xci  =  xoi  for  some  #01  €  (l/fcai2,  1)-  Then 
the  line  #0  to  xc  is  vertical. 

Case  1:  V;2(f,  #0)  does  not  intersect  with  the  line  #1  =  1 
before  it  reaches  #2  =  -1.  Applying  Green’s  Theorem 
to  the  region  enclosed  by  ^2  (*>  #0)  and  the  vertical  line 
xo  to  xc.  Since  dfi/dxi  +  df2/dx2  =  0  in  the  region, 
we  have 


f2(x)  dx  1  -  fi(x)  dx 2 

=  —  J  (“ #01  +  ^12^2)  dx 2  =  0. 


This  leads  to  #01  =  0,  which  contradicts  the  condition 
that  #01  >  l/ka,i2. 

Case  2:  ^2(tf,  #0)  intersects  with  the  line  #1  =  1  before 
it  reaches  x2  =  —  1.  Let  the  intersections  be  pi  = 
[a\]  )  P2  -  [^],  see  Fig.  8.  Again  applying  Green’s 
Theorem  to  the  region  enclosed  by  the  line  xc  to  #o> 
the  line  pi  to  p2  and  the  trajectory  ^2(i,  #o)>  we  get 


— #01  +  CI12X2)  dx 2 


ps  2 

+  /  (-1  +  012x2)  dx 2  =  0. 

J  S 1 


This  leads  to 


2xoi  =  (Si  -  52)  (51  +  52))  •  (30) 

By  Lemma  5.3, 5i  <  #01 »  s2  >  -#01  (=  is  taken  when 
k  =  1),  so  si -52  <  2#oi.  By  Lemma 5.4,  si+s2  >  0, 
so  (1  —  (ai2/2)  (si  +  82))  <  1.  This  contradicts  (30). 

Combining  the  two  cases,  we  must  have  xci  #01  for  any 
#01  €  (l/fcai2,  1).  Also,  by  continuity,  #oi  >  xci.  □ 

Proof  of  Lemma  5. 6 

At  x*y  #2  —  0,  #1  >  0,  so  x*)  goes  rightward.  By 
Lemma  5.3,  ^2(^7  x*)  will  not  intersect  with  the  line  #1  =  1 
before  it  turns  leftward.  Since  A  has  a  pair  of  pure  imaginary 
eigenvalues,  the  trajectory  will  touch  the  line  x2  =  —1  at  -#*. 
And  by  symmetry,  it  will  return  to  x*  thus  form  a  closed  curve. 
Note  that  because  at  ±x*,  x2  =  0,  so  fait 7  x*)  has  only  one 
intersection  with  each  of  the  lines  x2  =  1  and  x2  =  —  1.  It 
follows  that  faify  x*)  is  inside  the  central  square. 

If  xo  E  So,  then  ^2 (£,  xq)  will  stay  within  So  since  the  tra¬ 
jectories  will  not  intersect  with  ^2(t,  x*).  Thus  ^2(£,  a:o)  is  in 
the  linear  region  and  will  be  a  closed  trajectory. 

Since  ana2i  =  ka  12  >  (Z12  =  ai2a22,  Ui2  >  an  and 
^21  >  &22>  Condition  a)  in  Proposition  4.1  is  satisfied,  thus, 
every  trajectory  ^2(t,  xo )  of  (25)  will  enter  a  bounded  attractor 
and  hence  is  bounded.  To  prove  the  remaining  part  of  the  lemma, 
it  suffices  to  show  that  there  is  no  closed  trajectory  outside  So . 
We  prove  this  by  contradiction. 

Suppose  there  is  a  closed  trajectory  outside  of  So,  say  T,  then 
T  goes  clockwise  and  must  have  two  intersections  with  the  line 
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Fig.  13.  Illustration  for  the  Proof  of  Lemma  5.6:  Case  1.  Fig.  14.  Ilustration  for  the  Proof  of  Lemma  5.6:  Case  2. 


x2  =  1.  Denote  the  region  enclosed  by  F  as  5,  then  by  Green’s 
Theorem,  we  have 


By  symmetry  (exchanging  xx  and  x2  and  taking  the  inverse  of 
the  slope),  at  a  point  x  €  Fp3_^p4  the  slope  of  T'  is 


+ 


dx  i  dx  2  =  0. 


m(xi)  = 


—  1  CL12X1 
—kai  2  +  Xi 


Denote  the  area  of  a  region  X  as  A(X ),  then 

A(s  n  to  -  A(s  n  wo  =  o.  (3i) 

3ote  that  in  the  central  square  and  in  the  region  V,  R, 
fi/dxi  +  df2/dx 2  =  0,  in  Ut  dfi/dxi  +  df2/dx2  =  -1 
and  in  W,  dfi/dxi  +  df2/dx2  =  1.  Also  note  that  5  must 
be  symmetric  with  respect  to  the  origin.  Equation  (31)  implies 
that  T  must  also  intersect  with  the  line  x±  =  1  and  the  area  of 
the  part  of  5  in  the  region  U  and  that  in  the  region  W  must  be 
equal.  We  will  show  that  this  is  impossible. 

Case  1:  The  intersections  are  all  on  the  boundary  of  the  cen¬ 
tral  square.  See  Fig.  13,  where  pi,  p2  are  the  intersections  with 
x2  =  1,  p3,  p4  are  the  intersections  with  xx  =  1.  By  symmetry, 
r  should  intersect  with  x2  =  -1  at  -px.  The  contradiction  will 
be  A(S  nu)>  A(S  n  W). 

Denote 


Clearly,  .4(5  fl  W)  equals  the  area  of  the  region  enclosed  by 
r;3_p4  and  the  line  x2  =  1.  For  the  two  areas  ,4(5  fl  U )  and 
A(S  n  W)  to  be  equal,  FPl^P2  and  F'  4  must  have  two 
intersections,  say  xi  =  [*{*]  anda;r  =  with  xn  <  xri. 
At  the  left  intersection  xi ,  Fp3^P4  crosses  FPi->P2  upward  and 
at  the  right  intersection  xr,Fp3_>p4  crosses  rpi_^P2  downward. 
This  implies 

Vi  (xn)  <  772(^1),  Vifrn)  >  (33) 

Let 

7712(^1)  =  771  (xx)  -772(2:1) 

_  -  ai2(k  ~  l)(a;j  -  (k  +  l)ai2^i  +  1) 

(-^i  +ai2)(-Aa2i  +xi) 

then  7712( — 1)  >  0, 7712(1)  <  0  and  from  (33),  we  have 


1 - 1 

I-* 

L _ _ _ _ 1 

II 

cs 

» - 1 

M  Co 

^  K5 
] _ 1 

II 

fO 

’  1  ' 

_53. 

II 

( - 1 

^  «0 

1 _ ■ 

7712(^1)  <  0,  77l2(tfrl)  >  0. 


Then  by  Lemma  5.3,  53  <  s2 ,  54  >  —  (— si)  and  hence 


si  <  s4  <  33  <  s2.  (32) 

Get  a  symmetric  projection  of  FP3^P4  with  respect  to  the  line 
x1  =  x2  on  the  region  U  and  denote  it  as  (see  the  dashed 

curve  in  Fig.  13).  The  corresponding  intersections  with  the  line 
£2  =  1  are  p'3  =  [s£] ,  p4  =  [^].  From  (32),  p'3  and  p4  are 
ptweenpi  andp2. 

*  At  a  point  x  inFPl^P2 ,  the  slope  of  F  is 


Vi(x  1)  = 


-ka i2X\  ~F  1 

—xi  +  ai2 


The  function  changes  sign  three  times,  so  r)x2{xx)  has  at  least 
three  zeros  between  -1  and  —1,  Obviously  there  are  only  two 
zeros  in  this  interval,  hence,  Fp3_^p4  and  FP1^P2  cannot  have 
two  intersections.  Consequently,  A(S  f)U)  >  A(S  D  W).  A 
contradiction. 

Case  2:  F  intersects  with  the  lines  X\  =  1,  x2  =  1 
as  in  Fig.  14.  From  p2  to  ps,  the  slope  of  the  straight 
line  is  a  =  (~ka12  +  l)/( — 1  +  ai2)  <  -1,  so 

P2  ~  [i]||  >  ||P3  ~  [1]  ||-  From  Lemma  5.3,  ||p4  -  [ii]  ||  > 
— Pi  —  I— 1]  ||  =  ||j>i  —  [T]  ||.  note  that  T  is  symmetric 
and  must  intersect  with  x2  =  -1  at  —p\.  Hence,  if  we  get 
a  symmetric  projection  of  FP3->P4  on  the  region  U  (see  the 
dashed  curve  in  Fig.  14),  then  p4  is  to  the  right  of  pi  and  p3 
is  below  p2.  Suppose  >1(5  fl  U)  =  >1(5  fl  W),  FPl^P2  will 
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Fig.  1 5.  Illustration  for  the  Proof  of  Lemma  5.6:  Case  3 . 


Fig.  16.  Illustration  for  the  Proof  of  Lemma  5.8:  Case  I. 


P3~ 
Pi  ~ 


intersect  with  rp3_p4  twice.  This  is  impossible  as  was  shown 
in  Case  1. 

Case  3:  The  four  intersections  are  as  shown  in  Fig.  15. 
Similarly,  since  a  <  -1,  (3  >  1,  we  have  ||p2  -  [\]  II  > 

;n||  and  ||i*4 -[ii] ||  <  11-Pi  -  [iJl  = 

i]  |.  Also  get  a  symmetric  projection  of  TP3-ip4 
on  the  region  U  (see  the  dashed  curve  in  Fig.  15),  then  is 
below  pi  and  pf3  is  below  p2.  Similar  to  Case  1,  we  can  show 
that  A(S  DU)  >  A(S  n  W).  A  contradiction. 

Because  hi  <  0,  there  is  no  such  case  where  T  only  encloses 
[}i]  and  [71]  but  not  [{]  and  [ij]. 

©Combining  the  above  three  cases,  we  see  that  there  is  no 
osed  trajectory  that  intersects  with  any  of  the  lines  xi  =  ±1 
and  x2  =  ±1  twice.  So  there  is  no  closed  trajectory  outside  of 
So  and  if  a  trajectory  starts  outside  of  Sq,  it  will  converge  to  the 
boundary  of  So.  □ 


Proof  of  Lemma  5. 7 

Since  xo  is  outside  of  So  and  is  to  the  left  of  x*,  so  02  (t,  xo) 
goes  upward-rightward  at  first  After  crossing  the  line  x\  = 
l/fcai2,  it  goes  downward  and  returns  to  the  line  x2  =  1. 
Since  02(£,  xo)  goes  clockwise,  at  the  first  intersection  with 
the  line  x2  =  —1  it  crosses  the  line  downward,  so  x2  <0  at 
xc  and  Xd  >  —l/kai2.  Let  tm  be  the  time  when  02  (t,  xq ) 
intersects  with  x2  =  —1,  i.e.,  02(£m>  xo)  =  xc.  Suppose 
Xd  =  -x0i,  then  xc  =  -x0  and  {02 W  x0),  t  e  [0,  2tm]}  is 
a  closed  curve.  This  is  impossible  by  Lemma  5.6.  Now  suppose 
xci  >  — #oi>  then  xc  is  to  the  right  of  —  xq.  Let  the  region  en- 
closed  by  {ip2(t,  x0),  t  6  [0,  im]},  {V>2 (t,  -x0),  t  6  [0,  tm]}, 
the  line  xc  to  — xo  and  the  line  — xc  to  x0  be  S,  then  on  the  line 
from  xc  to  — xo ,  x2  <  0  and  x  points  outward  from  S.  Simi¬ 
larly,  on  the  line  from  —xc  to  xo,  x  also  points  outward  from  S. 
Thus,  no  trajectory  outside  of  S  will  enter  it.  This  contradicts 
with  Lemma  5.6  since  So  is  in  the  interior  of  S. 

Therefore,  we  must  have  —  (1/A;ai2)  <  xci  <  —xoi.  □ 


Because  xoi  >  Ijkayi ,  both  0(£,  xq7  a22 )  and 
0(f,  x o,  a22  -  8 )  go  downward-rightward  until  reaching 
the  line  x2  =  Xi/ai2  (see  the  dashed  line  passing  through  the 
origin).  (On  this  line,  ii  =  0).  After  that,  the  trajectories  turn 
leftward. 

At  t  =  0,  the  slopes  of  both  trajectories  are  negative  and 
7?(xo,  d22)  <  v(xo,  a22  ~  $)>  so  0(i,  x0,  a22  ~  8)  will  go 
to  the  right  of  0(£,  xo,  a22)  at  the  begining.  On  the  part  of 
0(£,  xo,  a22)  that  is  above  the  line  x2  =  ari/ai2,  r?(x,  a22)  < 
77(0:,  a22  —  8)  and  on  the  part  that  is  below  the  line  7?(x,  a22)  > 
r)(x ,  a22-8).  So0(^,  xo,  a22  —  8)  can  only  cross  0(£,  xo,  a22) 
leftward  below  the  line.  We  will  show  that  the  crossing  point  p 
(see  Fig.  16)  is  to  the  right  of  xo  and  xc.  After  the  crossing, 
0(£,  xo,  a22  —  8)  will  stay  to  the  left  of  0(t,  xo,  a22)  imtil 
meeting  the  line  x2  =  —1.  This  leads  to  the  desired  result. 

Let  si  —  [*®1]  ,  s2  =  [x^]  be  the  intersections  of 

0(£,  Xo,  a22)  and  0(^?  »22  —  5)  with  the  vertical  line 

%i  =  xoi,  respectively.  Since  xc  is  to  the  left  of  xo,  so  si  is 
above  the  line  x2  =  —  1.  Assume  on  the  contrary  that  there  is 
no  intersection  of  0(£,  xo,  a22  —  8)  with  0(t,  xo,  a22)  that  is 
to  the  right  of  the  line  xi  =  xoi,  then  si  must  be  above  $2,  i.e., 
ei  >  e2  and  0(t,  xo,  a22  —  8)  is  to  the  right  of  0(t,  xo,  ^22) 
before  meeting  the  line  xi  =  xoi  -  Denote  the  area  of  the  region 
enclosed  by  0(£,  xo,  a22)  and  the  line  from  xo  to  si  as  A  and 
the  area  of  the  region  enclosed  by  0(£,  xo,  a22  —  5)  with  the 
line  from  xo  to  s2  as  B ,  then  A  <  B.  Applying  Green’s  theorem 
to  the  vector  fields  corresponding  to  a22  and  a22  -  8 ,  we  have 

“  [  AW  dx 2  =A(a22  -  1)  (34) 

3  ej. 

f  /i(x)  dx2  =  B(a22  —  5  —  1).  (35) 

Je  2 


Note  that  /i(x)  =  —  xi  +  ai2x2  is  the  same  for  both  the  vector 
fields.  Subtracting  (35)  from  (34),  we  obtain 


Proof  of  Lemma  5.8 

j  Without  loss  of  generality,  assume  X02  =  1.  When  x02  € 
(0,  1),  the  proof  can  be  carried  out  similarly.  There  are  three 
cases. 

Case  1:  xoi  <  1  and  0(£,  Xo,  a22)  does  not  intersect  with 
the  line  xi  =  1  (see  Fig.  16). 


(B-A)(l-a22)  +  B8>0. 


We  know  that  /i(x)  <  0  from  <si  to  s2  since  the  trajectories 
go  leftward.  By  assumption,  e\  >  e2,  so  f**  /i(x)dx2  <  0. 
A  contradiction.  Therefore,  we  must  have  ei  <  e2  and 
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Fig.  17.  Illustration  for  the  Proof  of  Lemma  5.8:  Case  2. 


Fig.  1 8.  Illustration  for  the  Proof  of  Lemma  5.8:  Case  3. 


V>(t,  xo,  G22  —  8)  intersects  xo,  a22)  at  a  point  p  to  the 
right  of  xo. 

Case  2:  xoi  <  1  and  ^{t,  xo,  022)  intersects  with  xx  =  1, 
see  Fig.  17. 

Let  pi  be  the  first  intersection  of  i/j(t,  xo,  a22)  with  xi  =  1, 
p2  be  the  second  one. 

Let  the  horizontal  distance  from  V>( t ,  xo,  a22)  to 
ip(t,  xo,  a22  —  5)  at  pi  be  Ax  and  that  at  p2  be  A2.  Then 
Pi  +  [Aq]  =:  Pi  is  on  xo,  a22  —  5).  By  the  horizontal 
shifting  property  (12)  of  the  trajectories,  px,  022)  will 
intersect  the  line  xx  =  1  +  Ax  atp2  T-  ^A0l  j  =:  p2-  From  Fact 
^1,  p[,  a22  —  8)  also  returns  to  the  line  xx  =  1  +  Ax 

at  p'2.  Because  p[  is  on  ip(t,  xo ,  a22  —  8),  p[,  a22  —  8) 

overlaps  with  ip(t ,  xo,  a22  -  5).  It  follows  that  A2  =  Ax. 

Let  si,  s2  and p  be  defined  similarly  to  Case  1,  we  will  also 
show  that  s2  is  above  sx  by  contradiction.  First,  we  need  an 
upper  bound  for  Ax. 

Let  v  =  [jjj]  be  a  point  on  V>(f,  x0,  a22)  and  [Vl+A]  be  a 
point  on  rp(t ,  xq,  a22  —  6).  Define 


9&U  v2)  := 


(-kai2vi  +V2) 
—Vi  +  012^2 


then  the  slope  of  xo,  <222)  at  v  is  0229(^1,  ^2)  “  ?7i  and 
the  slope  of  ip(t,  x0,  a2 2  -  6)  at  ["l+A]  is  ( a22  -  S)g(v  1  + 
A,  v2)  —•  m- It  easily  can  be  verified  that  for  v2  >  0,  g(vi ,  v2) 
is  a  decreasing  function  of  14,  so 


g(v  1,  v2 )  >  p(ni  +  A,  v2 ),  V  A  >  0,  u2  >  0.  (36) 


We  can  view  A  as  a  function  of  v,.  Routine  analysis  shows 
that 

dA  _  -772 

dv  1  772 

Note  that  the  part  of  £0,  022)  from  #0  to  pi  is  above  the 
line  x2  =  0.  It  follows  from  (36)  that 

) 

77i  772  =a22g(vi,  v2)  -  (a22  -  S)g(vl  +  A,  w2) 

=  a22(5(ui,  v2)  -  g(v  1  +  A,  u2))  +  <5s(i4  +  A,  v2) 
>6g(v  1  +  A,  v2). 


Since  g(v  1  +  A,  u2)  <  0,  we  have 


dA  _ S_ 

dv  1  a22  —  5 


Therefore 


f 

t/XQl 


dA  .  S 

-j—  dvi  < - c 

civ  1  a22  *“  c 


(1  -  X01). 


(37) 


Let  Pi  be  the  intersection  of  the  extension  of  the  line 
from  pi  to  Pi  with  xx  =  xoi  and  p 2  be  that  of  the  line 
from  P2  to  P2  (see  Fig.  17).  Denote  Ai,  A2,  A3,  A± 
as  the  areas  of  the  regions  enclosed  by  straight  lines 
and  4>{t,  xo,  a22)  corresponding  to  the  sets  of  vertices 

{>0,  Pl,  J»l>,  {P2,  P2,  Si},  {Pi,  Pi,  P2,  P2'},  (Pi,  P2>, 
respectively.  Denote  Bi,  B2,  B±,  S5  as  the  areas 

of  the  regions  enclosed  by  straight  lines  and 

V>( t ,  Xo,  a22  —  5)  corresponding  to  the  sets  of  vertices 

{*0,  Pl,  Pl},  {p2,  P2,  S2},  {pi,  p'2},  {pi,  pi,  pi,  p2}, 
respectively.  Then  by  Green's  theorem,  we  have 


-/ 

Jei 


fi(x)  dx2  —  (—1  +  a22)(Ai  +  A2)  +  (~1  +  (*22)Az 


+  a22Ai 


(38) 


•  f  fi(x)  dx2  =  (-1  +  a22  -  S)(Bi  +  B2) 

J  e2 

+  (— 1  +  &22  ~  8) A3  -F  (&22  ~  8)B 4 
+  (a22  -  8)B6.  (39) 


Note  that  there  are  small  triangle  areas  in  B\  and  B2  that  are 
in  the  region  W.  They  are  of  the  order  82.  Since  8  is  arbitrarily 
small,  we  can  treat  them  as  a  region  in  the  central  square  for 
simplicity. 

It  follows  from  Fact  5.1b)  and  the  horizontal  shifting  property 
in  the  region  W  that  a22A±  =  (a22  —  8)B 4.  From  (37),  we  have 

(—1  +  a22)As  —  (—1  -f  a22  —  5)*43  —  (a22  —  8)B$ 

=  8  A3  —  (a22  —  8)B$ 

=  8\\pi  -  p2 1|(1  -  xoi)  -  (a22  -  5)||pi  -  p2||Ax  >  0. 
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By  assumption,  si  is  above  52,  so  Ai  +  A2  <  #1  +  #2-  Sub¬ 
tracting  (39)  from  (38)  we  get 


fi{x)dx2  >  0. 


A  contradiction  with  ci  >  e2  and  fi(x)  <  0. 

Case  3:  xoi  >  1  (see  Fig.  18). 

In  this  case,  xo,  a 22 )  goes  downward-rightward,  then 
turns  downward-leftward  and  returns  to  the  line  xi  —  xqi  at 
a  point,  say,  p  =  Because  hi  <  0,  p  is  above  the  line 

x2  =  —1.  By  Fact  5.1,  #o,  0*22  —  $)  will  also  return  to  the 

line  xi  =  a;oi  at  the  same  point  p.  After  that ,  ^(t,  #0,  &22  —  &) 
remains  to  the  left  of  xo>  a22)  untill  it  meets  the  line  x2  — 
—1  and  the  desired  result  follows. 


References 

[1]  F.  Albertini  and  D.  D’Aless,  “Asymptotic  stability  of  continuous-time 
systems  with  saturation  nonlinearities”  Syst .  Contr.  Lett.,  vol.  29,  pp. 
175-180,  Nov.  1996. 

[2]  D.  S.  Bernstein  and  A.  N.  Michel,  “A  chronological  bibliography  on  sat¬ 
urating  actuators,”  Int.  J.  Robust  Nonlinear  Contr.,  vol.  5,  pp.  375-380, 
Aug.  1995. 

[3]  L.  Hou  and  A.  N.  Michel,  “Asymptotic  stability  of  systems  with  satura¬ 
tion  constraints,”  IEEE  Trans.  Automat.  Contr. ,  vol.  43,  pp.  1 148-1154, 
Aug.  1998. 

[4]  L.  Jin,  P.  N.  Nikiforuk,  and  M.  M.  Gupta,  “Absolute  stability  conditions 
for  discrete-time  recurrent  neural  networks,”  IEEE  Trans.  Neural  Net¬ 
works,  vol.  5,  pp.  954-964,  Nov.  1994. 

[5]  Z.  Lin,  Low  Gain  Feedback,  ser.  Lecture  Notes  in  Control  and  Informa- 

®tion  Sciences.  London,  U.K.:  Springer- Verlag,  1998. 

[6]  D.  Liu  and  A.  N.  Michel,  “Asymptotic  stability  of  systems  operating  on 
a  closed  hypercube Syst.  Contr.  Lett.,  vol.  19,  pp.  28 1-285,  Oct.  1992. 

[7]  - ,  “Sparsely  interconnected  neural  networks  for  associative  memo¬ 

ries  with  applications  to  cellular  neural  networks,”  IEEE  Trans.  Circuits 
Syst.,  vol.  41,  pp.  295-307,  Apr.  1994. 

[8]  - ,  Dynamical  Systems  with  Saturation  Nonlinearities,  ser.  Lecture 

Notes  in  Control  and  Information  Sciences.  London,  U.K.:  Springer, 
1994. 


[9]  R.  Mantri,  A.  Saberi,  and  V.  Venkatasubramanian,  “Stability  analysis  of 
continuous  time  planar  systems  with  state  saturation  nonlinearity,”  IEEE 
Trans.  Circuits  Syst.  I,  vol.  45,  pp.  989-993,  Sept.  1998. 

[10]  J.  H.  F.  Ritzerfeld,  “A  condition  for  the  overflow  stability  of  second- 
order  digital  filters  that  is  satisfied  by  all  scaled  state-space  structures 
using  saturation,”  IEEE  Trans.  Circuits  Syst.,  vol.  36,  pp.  1049-1057, 
Aug.  1989. 


Tingshu  Hu  (S’99)  was  bom  in  Sichuan,  China,  in 
1966.  She  received  the  B.S.  andM.S.  degrees  in  elec¬ 
trical  engineering  from  Shanghai  Jiao  Tong  Univer¬ 
sity,  Shanghai,  China,  in  1985  and  1988  respectively. 

She  is  currently  working  toward  a  Ph.D.  degree  at 
the  Department  of  Electrical  Engineering,  University 
of  Virginia,  Charlottesville.  Her  research  interests  in¬ 
clude  systems  with  saturation  nonlinearities  and  ro¬ 
bust  control  theory. 


Zongli  Lin  (S’89-M'90-SM’98)  was  bom  in 
Fuqing,  Fujian,  China,  on  February  24, 1964.  He  re¬ 
ceived  the  B.S.  degree  in  mathematics  and  computer 
science  from  Amoy  University,  Xiamen,  China,  in 
1983,  the  M.Eng.  degree  in  automatic  control  from 
the  Chinese  Academy  of  Space  Technology,  Beijing, 
China,  in  1989,  and  the  Ph.D.  degree  in  electrical 
and  computer  engineering  from  Washington  State 
University,  Pullman,  WA,  in  May  1994. 

From  July  1 983  to  July  1986,  He  worked  as  a  Con¬ 
trol  Engineer  at  the  Chinese  Academy  of  Space  Tech¬ 
nology.  In  January  1 994  he  joined  the  Department  of  Applied  Mathematics  and 
Statistics,  State  University  of  New  York  at  Stony  Brook,  as  a  Visiting  Assistant 
Professor.  He  is  now  an  Assistant  Professor  in  Electrical  Engineering  at  the  Uni¬ 
versity  of  Virginia,  Charlottesville.  His  current  research  interests  include  non¬ 
linear  control,  robust  control,  and  control  of  systems  with  saturating  actuators. 
In  these  areas  he  has  published  several  papers.  He  is  also  the  Author  of  the  re¬ 
cent  book,  Low  Gain  Feedback  (London,  U.K.:  Springer- Verlag,  1998). 

Dr.  Lin  currently  serves  as  an  Associate  Editor  on  the  Conference  Editorial 
Board  of  the  IEEE  Control  Systems  Society.  He  is  the  Recipient  of  an  ONR 
Young  Investigator  Award. 


Publication  5 


824 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL,  VOL.  45,  NO.  4,  APRIL  2000 


Acknowledgment 

The  authors  are  grateful  to  the  reviewers  for  their  helpful  comments 
frd  suggestions. 


[1] 

P] 

[3] 

[4] 

[5] 
E6] 

[7] 

[8] 

[9] 

[10] 

[11] 


References 

I.  B.  Rhodes,  “A  parallel  decomposition  for  Kalman  filters  '"IEEE  Trans. 
Automat.  Contr. ,  vol.  35,  pp.  322-324,  1990. 

R.  A.  Singer  and  R.  G.  Sea,  “Increasing  the  computational  efficiency 
of  discrete  Kalman  filters,”  IEEE  Trans.  Automat.  Contr. ,  vol.  16,  pp. 
254-257, 1971. 

E.  Tse  and  M.  Athans,  “Optimal  minimal-order  observer-estimators  for 
discrete  linear  time-varying  systems,”  IEEE  Trans.  Automat.  Contr.  ,y  ol. 
15,  pp.  416-426,  1970. 

C.  T.  Leondes  and  L.  M.  Novak,  “Optimal  minimal-order  observers 
for  discrete-time  systems — A  unified  theory,”  Automatical  vol.  8,  pp. 
379-387,  1972. 

E.  Fogel  and  Y.  F.  Huang,  “Reduced-order  optimal  state  estimator  for 
linear  systems  with  partially  noise  corrupted  measurement,”  IEEE 
Trans.  Automat.  Contr. ,  vol.  25,  pp.  994-996,  1980. 

Y.  Halevi,  “The  optimal  reduced-order  estimator  for  systems  with  sin¬ 
gular  measurement  noise,”  IEEE  Trans.  Automat.  Contr.,  vol.  34,  pp. 
777-781, 1989. 

B.  Friedland,  “Treatment  of  bias  in  recursive  filtering,”  IEEE  Trans.  Au¬ 
tomat.  Contr. ,  vol.  14,  pp.  359-367, 1969. 

A.  T.  Alouani,  P.  Xia,  T.  R.  Rice,  and  W.  D.  Blair,  “On  the  optimality  of 
two-stage  state  estimation  in  the  presence  of  random  bias,”  IEEE  Trans. 
Automat.  Contr.,  vol.  38,  pp.  1279-1282, 1993. 

C. -S.  Hsieh  and  F.-C.  Chen,  “Optimal  solution  of  the  two-stage  Kalman 
estimator,”  IEEE  Trans.  Automat.  Contr. ,  vol.  44,  pp.  194-199,  1999. 

H.  A.  P.  Blom  and  Y.  Bar-Shalom,  “The  interacting  multiple  model  algo¬ 
rithm  for  systems  with  Markovian  switching  coefficients,”  IEEE  Trans. 
Automat.  Contr. ,  vol.  23,  pp.  780-783, 1988. 

G.  A.  Watson  and  W.  D.  Blair,  “Interacting  acceleration  compensation 
algorithm  for  tracking  maneuvering  targets,”  IEEE  Trans.  Aerosp.  Elec¬ 
tron.  Syst.,  vol.  3 l,pp.  1152-1159,  1995. 

W.  D.  Blair  and  G.  A.  Watson,  “Interacting  multiple  bias  model  algo¬ 
rithm  with  application  to  tracking  maneuvering  targets,”  in  Proc.  IEEE 
31th  Conf.  Decision  Contr.,  Tucson,  AZ,  Dec.  1992,  pp.  3790-3795. 


Adaptive  Control  of  a  Weakly  Nonminimum  Phase  Linear 

System 

Zongli  Lin  and  Gang  Tao 


Abstract — For  a  weakly  nonminimum  phase  linear  system,  we  design  an 
adaptive  state  feedback  control  law  that  causes  the  system  output  to  track 
a  desired  trajectory  to  an  arbitrarily  high  degree  of  precision.  The  key  to 
this  is  the  use  of  a  low  gain  feedback  design  technique. 

Index  Terms — Adaptive  control,  low  gain  feedback,  nonminimum  phase, 
tracking. 


I.  Introduction 

It  is  well  known  in  both  classical  and  modem  control  that  the  system 
minimum  phase  property  facilitates  control  designs  [1],  [3]-[5],  [7], 
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[9],  [10].  However,  many  practical  systems  are  nonminimum  phase 
[3].  The  nonminimum  phase  property  may  prevent  some  desired  con¬ 
trol  objectives  from  being  achieved.  One  of  such  objectives  is  that  the 
system  output  tracks  a  desired  trajectory.  Since  the  unstable  system 
zeros  cannot  be  cancelled  by  standard  state  or  output  feedback  con¬ 
trollers,  special  designs  are  usually  needed  for  output  tracking  purpose. 
Controllers  based  on  the  internal  model  principal  [1],  [4],  [5]  are  com¬ 
monly  used  for  nonminimum  phase  systems  in  order  to  achieve  output 
tracking  of  reference  signals  at  the  internal  model  frequencies. 

In  this  paper  we  explore  a  different  way  of  treating  nonminimum 
phase  systems  and  identify  conditions  under  which  certain  design  ob¬ 
jective  can  be  met  for  nonminimum  phase  systems.  In  particular,  by 
utilizing  the  recent  development  of  low  gain  feedback  design  tech¬ 
niques  [8],  we  show  how  adaptive  state  feedback  control  laws  can  be 
constructed  to  cause  the  output  of  a  weakly  nonminimum  phase  linear 
system  (a  system  whose  invariant  zeros  are  in  the  closed  left-half  of  the 
complex  plane)  to  track  a  given  reference  output  trajectory  to  an  arbi¬ 
trarily  high  degree  of  precision.  The  reference  output  trajectory  can  be 
any  smooth  signals  that  do  not  contain  the  frequency  components  of 
the  jw  axis  invariant  zeros. 

The  rest  of  the  paper  is  organized  as  follows.  In  Section  II,  we  for¬ 
mulate  the  problem  of  designing  adaptive  state  feedback  controllers  for 
weakly  nonminimum  phase  linear  systems  to  ensure  desired  tracking 
properties.  In  Section  III,  we  will  show  that,  with  the  use  of  a  low  gain 
feedback  design,  our  adaptive  controller,  when  applied  to  a  weakly  non¬ 
minimum  phase  linear  system,  ensures  the  closed-loop  signal  bounded¬ 
ness  and  an  output  tracking  error  whose  steady-state  trajectory  can  be 
made  arbitrarily  small.  We  will  also  present  an  example  with  simula¬ 
tion  results  to  illustrate  our  low  gain  adaptive  controller  and  its  desired 
tracking  performance.  A  brief  concluding  remark  is  made  in  Section  4. 

n.  Problem  Statement 

Consider  the  following  linear  system: 

r  x0  =  Aox0  4  BqXi,  xq  G  Rn° 

Xl  —  X2y  XlGR 

<  .  :  (1) 

Xr— 1  —  Xr 

xr  =  EqXo  4  a\X\  -| - +  arxr  4  bu,  b  >  0 

>y  =  xi 

where  x  =  [xq,  xi,  #2, . . . ,  xr]  G  FT0+r  is  the  state  vector,  u  G  R 
is  the  control  input,  y  G  R  is  the  system  output,  and  b  and  ai 's  are 
unknown  system  parameters.  We  have  assumed  that  b  ^  0,  and  without 
loss  of  generality,  further  assumed  that  b  >  b0  >  0  for  some  known  b0 . 

We  note  here  that  the  dynamics  of  xq  is  the  zero  dynamics  of  the 
system  and  the  eigenvalues  of  Ao  are  the  invariant  zeros  of  the  system. 
Also  note  that  this  system  has  a  relative  degree  of  r.  We  further  make 
the  following  assumptions  on  the  system. 

Assumption  I:  The  system  (1)  is  of  weakly  nonminimum  phase,  i.e., 
all  the  eigenvalues  of  A0  lie  in  the  closed  left-half  plane. 

Assumption  2:  The  system  (1)  is  stabilizable,  i.e.,  the  pair  (Ao,  Bo) 
is  stabilizable. 

Our  objective  is  to  construct  an  adaptive  state  feedback  control  law 
that  causes  the  system  output  y(t)  to  track  a  desired  output  trajectory 
ya  to  an  arbitrarily  high  degree  of  precision  without  knowing  the  values 
of  the  system  parameters  b  and  a*'s.  Unlike  in  the  adaptive  control  of 
minimum  phase  systems  in  which  A0  is  stable,  here  A0  is  unstable 
and  needs  to  be  stabilized  through  Bo .  For  this  reason,  we  require  the 
knowledge  of  Ao  and  Bo .  We  also  make  the  following  assumption  on 
the  desired  trajectory  yd. 
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Assumption  3:  The  desired  output  trajectoiy  yd  is  a  Cr  function  of 
time  t  with  all  yf\  i  =  1, 2, . . . ,  r,  bounded,  and  all  its  frequency 
components  are  away  from  the  jcj-axis  invariant  zeros  of  the  system. 

More  precisely,  we  will  solve  the  following  control  problem  under 
Assumptions  1,  2  and  3. 

Problem  1:  Consider  the  system  (1).  For  any  a  priori  given  (arbi¬ 
trarily  small)  number  y  >  0,  design  an  adaptive  state  feedback  control 
law, 

u  ~  (f>  ^Cko-»  *  * « » xo,  Xi,  •  *  •  9  Xr  j  2 fdi  Vdt  •  •  •  >  2 Id  | 

d*  =  tjj  fxo5  xi, .  ,  xr,  yd,  yd,  « « •  >  yd  ) »  i  0, 1, . . . ,  7* 

V  '  (2) 

such  that  all  signals  of  the  closed-loop  system  are  bounded,  and: 

a)  for  ya  =  0,  limt— oo  y(t)  =  0; 

b)  for  any  desired  trajectory  yd  that  satisfies  Assumption  3 

|e9S(*)|  <  V  (3) 

where  e  z=y—yd,  and  esa  ( t )  stands  for  the  steady  state  trajectory 
of  e(t). 


III.  Main  Results 


In  this  section,  we  first  explicitly  design  an  adaptive  state  feedback 
law  of  the  form  (2)  and  then  show  that  it  indeed  solves  Problem  1 .  Our 
design  is  carried  out  in  the  following  three  steps. 


Step  1: 


Step  1.1. 


Low  Gain  Feedback.  Consider  the  pair  (Ao,  Bo).  By  As¬ 
sumptions  1  and  2,  the  pair  (Ao,  Bo)  is  stabilizable,  and 
all  the  eigenvalues  of  A0  are  in  the  closed  left-half  plane. 
The  low  gain  feedback  design  can  be  described  in  the  fol¬ 
lowing  three  sub-steps. 

Find  nonsingular  transformation  matrices  Ts  such  that 
the  pair  (A0,  Bo)  is  transformed  into  the  following  con¬ 
trol  canonical  form: 


TslA0Ts 


'A°q  0 
.  0  ^o 


(4) 


R"oxno  are  on  the  jcu  axis  and  hence  ( ^4q  ,  B°)  is  con- 
trollable  as  given  by, 


’  0 

1 

0 

0  ■ 

O 

0  0 

II 

0 

0 

1 

0 

,  B°o  = 

0 

0 

0 

0 

1 

0 

0 

0 

-a?. 

.1. 

1 

We  note  here  that  the  existence  of  such  a  Ts  is  due  to  the 
fact  that  the  set  of  eigenvalues  of  Ag  are  disjoint  from  that 
of  Aq  .  An  efficient  algorithm  for  the  contruction  of  Ts 
can  be  found  in  [2]. 

Step  1.2.  For  the  (A®,  B$),  let  Fq  (e)  E  R1Xn°  be  the  state  feed¬ 
back  gain  such  that 

\(A00+B%Fg(e))  =  -e  +  \(A00)  6  CT,  e  >  0.  (6) 

Note  that  F°  (e)  is  unique.  Here  s  is  a  design  parameter 
whose  value  is  to  be  determined  by  the  desired  degree  of 
tracking  precision  77. 

Step  1 .3.  Form  a  feedback  gain  for  the  pair  (Ao ,  Bo )  as  follows: 

F0(e)  =  [*?(*)  0]  Ts1.  (7) 

It  is  clear  that  Fq  ( e )  tends  to  zero  as  e  tends  to  zero.  For 
this  reason,  the  feedback  gain  F°  (e)  is  referred  to  as  low 
gain  feedback.  The  properties  of  such  a  low  gain  design 
were  examined  in  detail  in  [8].  In  what  follows,  we  estab¬ 
lish  another  property  that  is  pertinent  to  the  development 
of  the  current  paper. 

Lemma  1:  Consider  the  triple  (A?,  B°  ,  Fq  (e))  as  given  by  (5)  and 
(6).  Then,  there  exists  an  e*  >0  such  that  for  all  e  E  (0,  £*], 


F°(e)  {jojl  -  A°0  -  B°F$(e))  1 


^eEE 

j=  1 


1 

(ju)  -  jui  +  sY 
(8) 


where  jui's  are  the  distinct  eigenvalues  of  Aq,  n;  is  the  algebraic  mul¬ 
tiplicity  of  jtJi ,  and  7  is  a  positive  constant  independent  of  e. 

Proof:  See  Appendix.  □ 


Step  2:  Output  Renaming.  Define  a  new  output  as 


y  =  x i  -  F0(e)xo  -  Vd  (9) 


where,  A0  E  Rno  Xn°  contains  all  the  open  left-half 
plane  eigenvalues  of  Ao,  and  all  eigenvalues  of  Ag  E 


where  ya  is  the  desired  trajectory  for  the  original  output 
y  to  track.  With  this  new  output,  the  system  (1)  can  be 
rewritten  as  (10),  shown  at  the  bottom  of  the  page,  where 


f  X o  =  (Ao  +  B0Fo(£))xq  +  Boy  +  Boyd ,  x0  E  R"° 
xi  =  x2 


X  r  —  1  —  Xr 

xr  =  do(e)x0  +  di(e)[xi  +yd]-i - h  ar(e)  [xr  4-  2/jr_1)J  +bu-  y^dr) 

<  y  =  xi 


(10) 


'  Xi  =  Xi  -  Fo(c)x0  -  yd 
x2  =  x2  -  F0(e)A0x0  -  Fo(e)B0xi  -  yd 
\  x3  ~  x3  Fo^AqXo  —  Fo(c)A0B0xi  -  F0(e:)Box2  —  ijd 

<  xr  =  xr  -  Fq(£)Aq^1xo  -  F0  (e)  Ar"2B0  xi - Fo(e)Boxr-i  -  Vd  ~^ 


(ID 


H*-  Ht- 
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we  have  defined  the  new  state  variables  as  shown  in  ( 1 1), 
also  shown  at  the  bottom  of  the  previous  page,  and  d{  (s)'s 
are  the  unknown  parameters,  defined  as  functions  of  the 
unknown  parameters  a,'s  and  the  design  parameter  e  in 
an  obvious  way. 

Step  3:  Adaptive  feedback  controller  design.  Let  us  first  consider 
the  x  =  [xi, X2, . . . , xr]'  subsystem 


r— 1  —  Xr 

r  =  do(e)xo  A  ai(s)zi  4  • 

ii  =  xi 


*  4  dr{e)zr  -4 -bu-  y{J 


(r) 


(12) 


where  x  =  [.ti  ,  x-2 , . . . ,  xr]f ,  and 


*  0 

1 

0 

0  ‘ 

“0" 

A  = 

0 

0 

1  ••• 

0 

,  B  = 

0 

0 

0 

0  ••• 

1 

0 

-*2 

-*3  ••• 

~fcr  _ 

.1. 

■fflo(e)' 

'do " 

a  = 

ai(e) 

,  a  = 

d  1 

,  z  = 

Z\ 

-“r(e). 

mar  _ 

.  zr  m 

(18) 


(19) 


where  for  i  =  1  to  r 


Zi 


*i+V(d  I}- 


(13) 


Our  task  here  is  to  stabilize  this  system.  Since  a;(e)’s 
depend  on  the  unknown  parameters  a,1  s,  we  choose  to 
design  an  adaptive  stabilizer  of  form: 


i 


u  =  ?v 

o 

(r) 

=  Vd 


V 


—a,QXQ  —  a\Z\  —  •  ■  ■  —  arzr 
—k  ixi  —  X2  —  •  ■  •  —  krxr 


(14) 


The  error  equation  (17)  then  motivates  us  to  choose  the 
adaptation  laws  for  b  and  a(t)  as, 


0, 

yx'PBu, 


if  b  =  b0  and  x'PBu  <  0 
otherwise 


8(0)  >  b0  (20) 


and 


a  =  TzxPB  (21) 

where  7  >  0  and  T  =  T'  >  0  are  adaptation  gains  and 
P  =  P'  >  0  is  the  unique  positive  definite  solution  to 
the  Lyapunov  equation 


where  ki's  are  positive  constants  such  that 


A!P  +  PA-  -Q 


(22) 


Sr+krSr  1  +”-  +  fc2S  +  fcl  (15) 

is  a  Hurwitz  polynomial  whose  roots  are  at  desired  loca¬ 
tions,  and  b  and  a;’s  are  design  parameters,  which  are  es¬ 
timates  of  b  and  di(£)'s,  respectively,  and  are  to  be  tuned 
adaptively. 

To  determine  the  adaptation  laws  for  tuning  the  pa¬ 
rameter  estimates  b  and  a^s,  we  consider  the  closed-loop 
system  under  the  control  law  (14),  shown  in  (16),  at  the 
bottom  of  the  page,  which  can  be  written  in  the  following 
compact  form: 


for  any  chosen  Q  =  Qf  >  0.  The  existence  of  such  a  P 
is  due  to  the  fact  that  A  is  asymptotically  stable  by  the 
choice  of  ki's. 

The  following  theorem  shows  that  our  adaptive  state  feedback  design 
indeed  meets  the  stated  control  objective. 

Theorem  1  (Solution  to  Problem  l);Un  der  Assumptions  1-3, 
the  adaptive  feedback  control  law  comprising  (14),  (20)  and  (21) 
ensures  that  all  signals  of  the  closed-loop  system  are  bounded,  and  the 
closed-loop  system  has  the  following  two  desired  properties, 

a)  for  yj  =  0,  lim^oo  x(t)  =  0; 

b)  for  any  yd  that  satisfies  Assumption  3  and  any  77  >  0,  there  exists 
an  e*  >0  such  that  for  all  e  G  (0,e:*] 


f  xq  =  {Ao  4  BoFo(e))xo  A  Boy  4  Boyd 

\x  =  Ax  A  B(a  -  a)fz  A  B(b  —  b)u  ^  '  |eS3(f)|  <  r/.  (23) 


fxo  —  (Ao  4-  Boi^oCc))^  A  Boy  A  Boyd 
Xi  =  £2 


xr—i  —  xr 

xr  —  —k\X  1  —  k2X2  —  •  •  ■  —  krxr 

A(d0(e)  -  ao)*o  A  (di(e)  -  di)zx  4 
.  y  =  xi 


'  4  («r(^)  -  dr)zr  A  (b  —  8)1 


) 


< 


(16) 
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Ptvof:  We  first  establish  that  the  solution  to  the  closed-loop  system 
equations  under  the  control  law  ( 1 4) — (2 1 )  exists  for  all  times.  To  this 
yid,  left  us  consider  the  Lyapunov  function  candidate, 

W  =  x'oPo  (e)x0  +  PxPx+P(d-d)'r-1(a-a)  +  -{b-b)(b-b) 

(24) 

where  Po(e)  >  0,  e  >  0  is  the  unique  solution  to  the  Lyapunov  equa¬ 
tion 

(j4o  4  BoFo(£))f  Pq  4  Po(Aq  4  PoPo(^))  =  —L  (25) 
and 


0,  for  all  i  =  1  to  r .  This  establishes  Property  (a).  To  establish  Property 
(b),  we  consider  the  first  equation  of  the  closed-loop  system  (10) 

xo  =  (^4o  4  BoFo(e))xq  +  Boy  4  Boyd •  (30) 

Since  lim*— oo  y(t)  =  limt—oo  (t)  =  0,  the  steady  state  trajectory 
of  x0  is  all  due  to  the  input  yd .  Assumption  3  and  Lemma  1  then  imply 
that,  for  any  given  rj  >  0,  there  exists  an  e*  >  0  such  that 

|(Fo(e)x0)J  <  V,  Ve  S  (0,e*J.  (31) 

Finally,  from  the  expression 

e(t)  =  y  -  yd  =  ®i  -  yd  =  y  4  F§ (e)*o  (32) 


0  =  2\-UQ)\\Po(e)Bo\\2. 


(26)  and  the  fact  that  limt—oo  2/00  =  0,  we  have 


The  existence  of  such  a  P(e)  is  guaranteed  by  the  fact  that  Aq  4 
BoFo(e)  is  asymptotically  stable. 

The  evaluation  of  the  derivative  of  W  along  the  trajectories  of  the 
closed-loop  system,  using  (20)  and  (21),  then  yields 

W  <  “xixo  4  2xoPo(e)Boy  4  2xoPo{e)Boyd  -  0xQx 
4  2 0xPB(a  -  a)'z  4  2 0x'PB(b  -  b)u 

-2/3(a-a)r-1a-  ^(6-S)S 

7 

<  —  -x0xo  4  2x'oPoBoyd 

<  2||ft(e)Bo||y3  (27) 

which,  together  with  the  fact  that  yd  is  bounded,  shows  that  the  solution 
Jndeed  exists  for  all  times. 

jl  To  continue  our  proof,  we  consider  the  dynamics  of  x,  a  and  b ,  to 
which  xo  is  viewed  as  an  external  signal.  Choose  a  Lyapunov  function 
candidate  as 

v  =  x'Px  +  (a  -  a)T-1(a  -  a)  +  -(b  -  b)'(b  -  S).  (28) 

7 

Then  the  derivative  of  V  along  the  trajectories  of  (17)  and  (14)  is  given 
by 

V  =  -xQx  4  2 xrPB(a  -  a)' z  4  2 x'PB(b  -  b)u 

-  2(a  -  a)r_la  -  -(6  -  S)S 

7 

<  -xQx  (29) 

from  which,  we  conclude  that  x  G  L2  fl  Loo  and  a,  b  G  Loo .  Using  the 
facts  that  yd  6  Loo  and  y  =  x\  G  Lq©,  we  see  from  the  first  equation 
of  (10)  that  xo  G  Loo,  which,  together  with  the  fact  that  G  Loo 

for  i  =  1, 2, . . . ,  r ,  implies  that  z  G  Loo.  From  the  definition  of  u  in 
(14),  we  see  that  u  G  L^ .  Hence  we  have  shown  that  all  signals  of  the 
closed-loop  system  are  bounded. 

We  now  proceed  to  show  the  desired  properties  (a)  and  (b).  It  follows 
from  (17)  that  x  G  Loo,  which,  together  with  the  fact  that  x  G  L2, 
implies  that  x(t)  — ►  0  as  t  — ►  oo  [1 1]. 

In  the  case  that  yd  s  0,  it  follows  from  the  first  equation  of  (1 0)  that 
lim^oo  x0(t)  ~  0.  Using  this  in  (1 1),  we  have  that  lim*— oo  Xi  (0  = 


|esS(i)l<»?»  Ve  G  (0, e*].  (33) 


This  completes  the  proof  of  the  theorem,  □ 

In  what  follows,  we  use  an  example  to  demonstrate  the  performance 
of  our  adaptive  low  gain  state  feedback  controller. 

Example:  Consider  the  following  linear:  system, 


'0  1“ 
0  0 


Xo  4 


0 

1 


y i 


(Xl  =  x2 

X2  =  aixi  4  0.2X2  4  bu 
y  =  x  1 


Xo  =  [x0l,X02r 


(34) 


where  ai7  a2  and  b  >  1  are  unknown  parameters.  Clearly  this  system 
is  in  the  form  of  (1)  and  it  is  weakly  nonminimum  phase  and  has  a 
relative  degree  of  2. 

Following  the  design  procedure  and  choosing 


fci  =  l,  k2  =  2,  r  =  2J,  7  =  2,  Q  =  I  (35) 


we  construct  the  family  of  adaptive  control  laws  parameterized  in  s, 
shown  at  the  bottom  of  the  page,  with  the  adaptation  laws  given  by 


a  = 


6  = 


Xo 

£2Xoi  4  2eXQ2  4  Xl  |  w, 

L  £2  x02  4  2^X1  4  X2  J 
0  \fb  =  bo  and  wu  <  0 
wu  otherwise 


6(0)  >  1 


£2xqi  4  (2e  -  e2)x02  4  (1  -  2e)xi  -  x2  -  yd  4  yd]u. 

(37) 

Figs.  1  and  2  show  some  simulation  results.  In  these  simulations,  the 
initial  conditions  are  chosen  as  random  numbers,  ai  =  1,  a2  =  2, 
6=2,  the  desired  input  is  yd  =  sin  £,  and  £  =  0.1,0.01.  It  is  clear 
from  these  simulations  that  the  adaptive  control  law  (36)  does  achieve 
the  desired  properties  of  the  closed-loop  system. 


IV.  Conclusion 

In  this  paper,  we  have  utilized  the  recent  development  in  low  gain 
feedback  design  techniques  in  the  design  of  adaptive  state  feedback 
control  laws.  The  resulting  adaptive  control  laws  are  capable  of  causing 
the  output  of  a  weakly  nonminimum  phase  linear  system  to  track  a  de¬ 
sired  trajectory  to  an  arbitrarily  high  degree  of  accuracy.  The  extension 


V 

b 


v  =  yd  4  2 yd  4  jjd  -  a0x0  -  [(cli  4  l)e2  2a1£  4  2a2e2  4  2e  4  2c2]x0 
— (ai  +  2ea.2  +  1  +  ie)xi  —  (S2  +  2)r2 


(36) 
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Fig.  I .  Closed-loop  performance  for  €  =  0 . 1 . 


of  this  design  approach  to  strictly  nonminimum  phase  systems  and  to 
the  output  feedback  case  is  currently  under  investigation. 


Appendix 
Proof  of  Lemma  1 


Let 


det(sJ  -  A°)  =  jj(s  —  A,)n\  ni-fniH - b  np  =  tiq  (A.l) 

«= 1 

where  A =  jcj*  and  A ,•  =£  A j,  i  ^  j.  Then,  for  each  i  =  1  to  p,  the  nt 
generalized  eigenvectors  of  Aq  are  given  by  the  following  ([6]): 


Pi  = 


■  1  ■ 

0 

A; 

1 

Af 

2A  i 

,  p\  = 

3Af 

a”°-2 

A”°_1 

.(no  —  1)A”°~'2. 

r 

0  1 

Pn€ 


0 

0 


^n,-i  v«( 

°ng-2Ai 


CnX~l  An°~~n’ 


Fig.  2.  Closed-loop  performance  for  e  =  0.01 . 


Similarly,  for  each  i  =  1  to  p,  the  n*  generalized  eigenvectors  of  A  *f 
BF(e)  are  given  by 


Qi  = 


■  i  ■ 

— 1 

O 

A„ 

l 

A?, 

2Aji 

A"?-2 

7  — 

3Ajj 

Ano_1 

Aei  J 

-k-i)a:p-2. 

r 

o  1 

ffn<  = 


0 

0 


1  \no“nt"~l 
°ng-2A« 

cnr\\"?~nt 


where  Ac;  =  —  £  +  Ai  and  C*  0  is  defined  as 
no 


f  nnQ! 

-  0  =  J 

0  \o 


0  <  f  <  ng 
otherwise 


We  next  form  the  following  two  nonsingular  transformation  matrices 
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|Po  (e)  (sI-A%-  B°FS(e))  1 1  =  |r  [F00(e)e('4°+B"F“(c))‘]  |  =  | C  [f° (e)Q(e)ec3-1(,r)(/l»+soFo0W),3WtQ-1(e 

<  (IP'1!  +  1)  £  | FS(S)  [q[, q'2, . . .  ,q‘n ,]  £[e',*“]| 


=  fi£(|P"1|  +  l)£ 


*=1 


eXcit  teXeii  t2eXei  1 /2\  t71*"1  eXcit /(m  -  1)! 

0  eXcit  teXcii  *•*  tni~2eXcit/(rii  -  2)! 


0  0 


:fi£(|P_1|+l)EEK-i  +  l) 

i=l  3  =  1 


0 

1 


p^ei  i 


(s  -  juii  +  £:)■> 


(A-7) 


which  is  independent  of  e ,  and 

Q(s)  —  [^1,  #2?  •  •  •  9  Ql  ?  £2  5  *  •  •  >  <?np]  • 

It  then  follows  that 


0 

0 

*■? 

'A,  10- 

•  0  ' 

II 

a, 

0  0 

0  j2  •••  0 

ll 

0  Ai  1  ■ 

•  0 

1 

• 

*  O 

*  O 

_ 1 

.0  0  0  -* 

- 1/ 

■  ^ . 

(A.2) 


and 


Q-1(e)  (AS+B0°P00(e))Q(e)  = 


J«  = 


0  •• 

0  Jc2  •• 

0  0 

Ac,  1  0 

0  Aci  1 

0  0  0 


It  was  shown  in  [8]  that 


FS(s)q)  <6)eni~i+l 


J 

(A.3) 


(A-4) 


where  6)  is  some  positive  constant  independent  of  e. 

We  also  note  that  both  Q(e)  and  Q~‘1(s)  are  continuous  functions  of 
e  satisfying  Q(0)  =  P  and  Q"1  (0)  =  P~l .  Now  from  the  continuity 
of  norm  functions  it  follows  that  there  exists  an  e*  £  (0, 1],  such  that 
for  all  e  6  (0,e*] 

|Q(e)|<|P|  +  l,  \Q-l(e)\<\P~l\  +  l.  (A.5) 

We  are  now  ready  to  show  (8).  Using  the  the  following  fact  about  the 
Laplace  transform 

eA‘ =  £"*((  si -A)-1]  (A.6) 

on  the  matrix  -A°  +  Bg  Fq  (e),  we  have  (A.7),  shown  at  the  top  of  the 
page,  where  <5  =  maxf=1  max”i1  6j. 

Hence,  we  have 

I  Jo  (O  {jul  -Al-  B°0FS  (e))~l  I  <  E  E 


J  =  1 


|  (jw-jwi +e  y 
(A.  8) 

]iere  7  =  8(\P  *|  +  l)n3.  This  completes  the  proof  of  Lemma  1.  □ 
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Abstract 

We  consider  the  problem  of  enlarging  the  basin  of  attraction  for  a  linear  system  under  saturated  linear  feedback.  An 
LMI-based  approach  to  this  problem  is  developed.  For  discrete-time  system,  this  approach  is  enhanced  by  the  lifting 
technique,  which  leads  to  further  enlargement  of  the  basin  of  attraction.  The  low  convergence  rate  inherent  with  the  large 
invariant  set  (hence,  the  large  basin  of  attraction)  is  prevented  by  the  construction  of  a  sequence  of  invariant  ellipsoids 
nested  within  the  large  one  obtained.  ©  2000  Elsevier  Science  B.V.  All  rights  reserved. 


Keywords:  Basin  of  attraction;  Invariant  set;  Saturation;  Lifting  technique 


1.  Introduction 

The  notion  of  invariant  set  has  played  an  important  role  in  the  analysis  and  design  of  dynamical  systems 
(see,  e.g.,  [2,3,7,15]  and  the  references  therein).  For  a  stable  linear  system,  a  simple  and  popular  type  of 
invariant  set '  is  the  level  set  Q(P)  =  {x:xTFxs:i},  associated  with  the  Lyapunov  function  V(x)  =  xrPx. 
Another  type  of  well-studied  invariant  set  is  polyhedra  (see,  e.g.,  [1,7]). 

For  linear  systems  under  saturated  stabilizing  linear  state  feedback,  both  the  problem  of  estimating  the 
basin  of  attraction  (the  largest  invariant  set)  for  a  specific  feedback  gain  matrix  and  that  of  searching  for 
an  appropriate  feedback  gain  matrix  to  result  in  a  large  basin  of  attraction  are  of  paramount  importance  and 
have  attracted  a  great  deal  of  attention  from  the  control  research  community.  Although  these  problems  are 
still  far  from  being  completely  solved,  recent  literature  shows  that  they  have  been  examined  extensively  from 
various  aspects  (see,  e.g.,  [1,6,9,11]  and  the  recent  survey  paper  [2]).  In  particular,  in  [9],  we  investigated 
continuous-time  linear  systems  under  saturated  stabilizing  linear  feedback.  We  showed  that,  if  the  system  is 
of  second  order  and  has  both  open-loop  poles  in  the  open  right  half-plane,  the  boundary  of  the  basin  of 
attraction  is  the  unique  unstable  limit  cycle  of  the  closed-loop  system  and  can  be  easily  obtained  from  its 
time-reversed  system.  Moreover,  a  family  of  gain  matrices  can  be  designed  to  obtain  a  basin  of  attraction  that 
is  arbitrarily  close  to  the  null  controllable  region,  the  largest  possible  basin  of  attraction  under  any  bounded 
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controls.  Though  complete  for  the  second-order  continuous-time  systems,  these  results  cannot  be  extended  in 
an  obvious  way  to  either  general  higher-order  systems  or  discrete-time  systems,  which  do  not  always  have 

time-reversed  systems.  . 

For  general  linear  systems  under  saturated  linear  stabilizing  feedback,  usually  only  an  estimate  ot  the  basin 
of  attraction  can  be  obtained.  A  simple  way  of  estimating  the  basin  of  attraction  is  the  largest  linear  invariant 
ellipsoid  associated  with  a  quadratic  Lyapunov  function.  By  linear  invariant  ellipsoid,  we  mean  an  invariant 
ellipsoid  that  is  completely  within  the  linear  region  of  the  saturation  function.  This  estimate,  though  often 
conservative,  can  be  improved  by  an  appropriate  choice  of  the  Lyapunov  function  and  the  feedback  gain 
matrix.  For  example,  in  the  case  that  the  open-loop  system  is  not  exponentially  unstable,  the  linear  invariant 
ellipsoid  can  be  made  large  enough  to  cover  any  a  priori  given  (arbitrarily  large)  bounded  set  [11]. 

The  objective  of  this  paper  is  to  present  a  systematic  approach  to  the  design  of  the  feedback  laws  that 
result  in  large  basin  of  attraction  for  general  linear  systems,  both  in  continuous-  and  in  discrete-time.  More 
specifically,  we  will  present  an  LMI-based  approach  to  maximizing  the  linear  invariant  ellipsoid.  Given  a 
reference  set  XK,  the  maximization  is  in  the  sense  that  the  linear  invariant  ellipsoid  contains  the  set  aXR  with 
a  being  maximized.  In  the  case  that  the  open-loop  system  is  not  exponentially  unstable,  our  design  results  in 
linear  invariant  ellipsoid  that  includes  any  a  priori  given  (arbitrarily  large)  bounded  set  as  a  subset.  This  is 
the  so-called  semi-global  stabilization  [11-13].  For  discrete-time  systems,  we  show  that  this  approach  can  be 
enhanced  by  the  lifting  technique,  which  leads  to  further  enlargement  of  the  basin  of  attraction.  Finally,  the 
low  convergence  rate  inherent  with  the  large  basin  of  attraction  can  be  prevented  by  constructing  a  sequence  of 
invariant  ellipsoids  nested  within  the  large  one  obtained  and  optimizing  the  convergence  rate  of  the  piecewise 
linear  controller  of  Wredenhagen  and  Belanger  [15]. 

The  remainder  of  this  paper  is  organized  as  follows.  In  Section  2,  we  present  an  LMI  approach  to  the 
maximization  of  the  linear  invariant  ellipsoid  for  both  continuous-  and  discrete-time  systems.  In  Section  3, 
we  show  how  the  lifting  technique  can  be  used  to  further  enlarge  the  basin  of  attraction  for  discrete-time 
systems.  In  Section  4,  we  show  how  the  closed-loop  system  convergence  rate  can  be  increased  by  switching 
the  feedback  gains  between  nested  sequence  of  linear  invariant  ellipsoids.  Two  examples  are  included  in 
Section  5  to  demonstrate  the  effectiveness  of  the  proposed  design  techniques.  Concluding  remarks  are  made 
in  Section  6. 


2.  Maximizing  the  linear  invariant  ellipsoid 

Consider  the  system 

x(k  +  l)  =  Ax(fc)  +  M«(*))>  xeU"’  “SIT,  (1) 

where  (A,B)  is  stabilizable.  In  this  paper,  we  use  cr(-)  to  denote  a  standard  saturation  function  of  appropriate 
dimensions.  For  example,  in  the  above  system,  cr:Rm  —  R",  and  a(u)  =  [ff(ui),<r(u2 ),..., ff(um)]  ,  where 
a(uj)  =  sgn(u,)min{l,  |w,|}.  The  closed-loop  system  under  the  feedback  law  u  =  Fx  is  given  by 

x(k  +  1)  =  Ax(k)  +  Ba(Fx(k)).  (2) 

Let  ft  be  the  ith  row  of  F.  Denote  the  linear  region  of  system  (2)  as 

L(F)  :=  {x  e  IR":  \fa\  <  1, i  =  1, 2,. . . ,m}. 

Let  F  be  such  that  A  +  BF  has  all  its  eigenvalues  inside  the  unit  circle,  then  there  exists  P  >  0  such  that 
(A  +  BF)rP(A  +  BF)  -  P  <  0. 

Denote  the  Lyapunov  level  set  as  £(/>):={*  6  W:xxPx^  1}.  If  Q(P)cL(F),  then  Q(P)  is  an  invariant  set 
and  we  call  it  a  linear  invariant  ellipsoid. 

Our  design  objective  is  to  choose  F  and  P  such  that  Q(P)CL(F)  is  maximized  m  some  sense.  In  the 
literature,  e.g.,  [4],  the  largeness  of  a  set  is  usually  measured  by  its  volume.  Here  we  will  take  its  shape 
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into  consideration  and  will  maximize  12(F)  with  respect  to  some  reference  set.  To  make  the  problem  well 
formulated,  we  introduce  a  reference  set  Xr.  Let  Xr  be  a  bounded  convex  set,  denote 

ocXr  =  {ax:  x  €  Xr}. 

The  linear  invariant  ellipsoid  Q(P)  is  said  to  be  maximized  over  Fan  d  P  if  a  is  maximized  such  that 
uXrcQ(P)cL(F).  In  practice,  the  shape  of  XR  can  be  determined  by  the  partial  knowledge  of  the  initial 
states.  It  can  also  be  chosen  according  to  the  shape  of  the  null  controllable  region,  as  identified  in  [9,8].  In 
this  paper,  we  will  consider  two  types  of  XR: 

•  The  polygon:  XR  =  co{xi,x2,...,x/}  is  the  convex  hull  of  a  given  set  of  states  xi,x2,...,x;  G  R"; 

•  The  ellipsoid:  Xr  =  {x  €  R":  xTFx  ^  1},  R  >  0. 

Given  system  (1)  and  Xr,  the  optimization  problem  can  be  described  as  follows: 


sup  a 

P>0,F 

s.t  (a)  oXR  C  13(F), 

(b)  Q{P)  C  L(F), 

(c)  (A  +  BF)tP(A  +BF)-P<  0. 

We  also  define  the  supremum  of  a  as  a*. 

If  XRis  a  polygon,  then  constraint  (a)  is  equivalent  to 

o^xJPx,  <  1 ,  i  =  l,2,...,/. 

If  XRis  an  ellipsoid,  then  constraint  (a)  is  equivalent  to 
a2F<F. 


(3) 

(4) 

(5) 


On  the  other  hand,  constraint  (b)  is  equivalent  to 

min{xTFx:  fix  =  1}  >  1,  i  =  1, 2, . . . ,  m.  ($) 

To  see  this,  note  that  13(F)  C  1(F)  if  and  only  if  all  the  hyperplanes  ftx  =  ±  1,  /  =  l,2,...,m,  he  completely 
outside  of  /3(F)  =  {x  G  R":  xTFxs=  1},  i.e.,  at  each  point  x  on  the  hyperplanes  ftx  =  ±1,  we  have  x  Fx>  1. 

The  left-hand  side  of  (6)  is  a  convex  optimization  problem  and  has  a  unique  minimum.  By  using  the 
Lagrange  multiplier  method,  we  obtain 

min{xTFx:  fix  =  1}  =  {fiP~X  f? )""*• 


Consequently,  constraint  (b)  is  equivalent  to 
fiP~xfJ<  1,  i  =  l,2,...,m. 


(7) 


Thus,  if  XRis  a  polygon,  then  (3)  can  be  rewritten  as  follows: 


sup  a 

J°>0/ 

s.t  (a)  cc2xJPxi  <  1,  /  =  1, 2, . . . ,  /,  (8) 

(b  )fiP~'f?^h  i=l,2,...,m, 

(c)  (A  +  BF)JP(A  +BF)-P<  0. 

If  XRis  an  ellipsoid,  we  just  need  to  replace  (a)  with  (5). 

Constraints  (a)-(c)  are  nonlinear  and  convex.  The  standard  tool  to  transform  such  constraints  into  LML  is 

Schur  complements:  Suppose  Q  >  0,  then  the  LMI 
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if  and  only  if  R-SQ~'ST'^0.  Let  y=  1/a2,  Q=P~l,  Y=FP~l,  then  we  can  transform  (8)  into  the  following 
LMI  problem: 


inf 

e,y 


s.t. 


7 

(a) 


T  "I 


7  x! 

Q 


>0,  1  =  1,2,...,/, 


(b) 

(c) 


i  =  1,2, 

r  Q  QAt  +  ytbt  I 

AQ  +  BY  Q  1 


(9) 


where  we  have  used  y,  to  denote  the  /th  row  of  Y.  For  the  case  where  Zr  is  an  ellipsoid,  we  can  simply 
replace  (a)  in  (9)  with  yQ^I&  .  We  will  denote  the  infimum  of  7  in  the  above  optimization  problem  as 
y*  =  l/(a*)2. 


Remark  1.  When  y=y*,  there  may  not  exist  Q  and  Y  that  satisfy  (a)-(c)  in  (9).  In  this  case,  we  can  choose 
y  =  y*  +  s  with  e  arbitrarily  small  and  solve  for  feasible  solutions  satisfying  the  constraints.  For  example, 
suppose  A  has  all  its  eigenvalues  on  or  inside  the  unit  circle,  then  y*  =0  [11]  and  no  Q  >  0  satisfies  (a)  or 
(5).  By  taking  y  arbitrarily  small,  we  can  make  the  set  oZR  C  Q(P)  C  L(F)  arbitrarily  large,  i.e.,  semi-global 
stabilization  [12,13]  can  be  achieved. 


Remark  2.  The  above  optimization  method  can  be  easily  adapted  to  the  continuous-time  system  by  replacing 
(c)  in  (8)  with  (A  +  BFfP  +  P(A  +  BF)  <  0  and  (c)  in  (9)  with  QAT  +AQ+  YrBJ  +  BY  <  0. 


3.  Further  enlargement  of  basin  of  attraction  via  lifting  technique 


The  lifting  technique  has  been  used  to  improve  the  robust  performance  of  discrete-time  systems  in  [10]  and 
to  design  semi-global  stabilizing  controller  in  [5].  Here  we  will  show  that  it  can  also  be  efficiently  used  to 
enlarge  the  basin  of  attraction.  Let  N  ^  1  be  a  positive  integer.  Denoting 

A=An,  B  =  [An~xB  An~2B  ■■■B] 


and 


x(k)  =  x(kN),  u(k)  = 


u(kN ) 
u(kN  +  1) 


[u(/aV+/V-  1) 

we  obtain  the  lifted  W-step  system 


x(k  +  1)  =Ax(k)  +(Ba  u(k)),  x  €  R",  m  £  KWm.  (10) 

Let  u(k)  =  Fx(k),  F  6  RWmXn  be  a  stabilizing  feedback.  The  closed-loop  system  is 

x(k  +  1 )  =  Ax(k)  -t -0a  Fx(k)).  ( 1 1 ) 

Similar  to  the  one-step  case,  the  problem  of  maximizing  the  linear  invariant  ellipsoid  can  be  described  as 


sup  a 

p>o,/ 

s.t.  (a)  oZR  C  Q(P),  (12) 

(b) D(P)Cl(F)  (or/fP-'/^l,  i  =  l,2,...,Nm), 

(c)  (I  +  BF)tP(A  +BF)-P<  0 
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which  can  be  solved  by  the  LMI  approach  proposed  in  the  previous  section.  Denoting  the  supremum  of  a  as 
a*(N),  we  have  the  following  theorem  that  justifies  the  use  of  lifting  technique. 


Theorem  1.  For  my  integers  p,N^l,  a*(p)^a*(pN). 


Proof.  Case  1:  p=  1.  Denote  the  set  of  feasible  (a ,P)  satisfying  constraints  (a)-(c)  as 

0(N)  =  {(a,P):  ELF  s.t.  (a),  (b)  and  (c)  are  satisfied}. 

It  suffices  to  show  that  0(1  )C  <P(N). 

Suppose  that  (a,P)  6  0(1),  then  there  exists  an  F  e  Rmxn  such  that 

1, 

and 

(A  +BF)TP(A  +  BF)-P<  0 


which  is  equivalent  to 


f  P  (A  +  BF)t  1 
A+BF  P~x 


>0 


and  to 


(A  +  BF)P~,(A  +BF)T  -  P_1  <  0. 


Let 


F  = 


F 

F(A+BF) 


F(A  +  BF)‘ 


ft- 1 


then 


A  +  BF = An  +  An~ XBF  +  AN~2BF(A  +  PF)  +  •  •  •  +  BF(A  +  BF)N~X  =(A+BF)N. 


It  then  follows  from  (14)  that 

(A  +  BF)tP(A  +  BF)  =  ((A  +  BF)rfP(A  +  BFf  <  ((A  +  BF?f-xP{A  +  BF)N~l  < 

which  shows  that  P  and  F  satisfy  constraint  (c). 

Since  fj  =  fi(A  +  BF)q  for  some  i^m,  q^N  -  1,  we  have 

fjP-xfJ  =  ft(A  +  BF)qP~x((A  +  BF?)qf?. 

It  follows  from  (13)  and  (15)  that 

fjP-'fJ  ^ fi{A  +  BFf-'p- 1  ((A  +  BF)r)q-xf?  1 

which  shows  that  P  and  F  also  satisfy  constraint  (b).  Hence  (a,P)  €  <P(N). 

Case  2:  p>  1.  Let 

A=AP,  B  =[Ap~lB  AP~2B  ■••B] 

and 

A=ApN,  B=[ApN~xB  ApN~2B  •P], 

then 

A  =  AN,  B  =  [AN~XB  AN~2B  •  •  •  P]. 


(13) 

(14) 


(15) 


<P 
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Suppose  we  first  lift  system  (1)  with  step  p  to  get  x(k)  =  x(kp), 

x(k+\)  =  Mk)  +  Mu(k)), 

then  lift  the  above  system  with  step  N  to  get  x(k)  =  x(kN)  =  x(kNp), 
x(k  +  1)  =Ax(k)  +(Ba  u(k)). 

Applying  the  result  in  Case  1,  we  immediately  have  a*(p)^a*(pN).  □ 

Remark  3.  The  equality  a*(p)  =  a*(pN)  with  N  >  1  can  occur  in  some  special  cases.  For  example,  let 
A  =a  >  1,  B  =  1,  and  XK  =  [  -  1, 1].  It  can  be  verified  that  a*(W)  =  l/(a  -  1)  for  all  N>1. 

From  the  above  theorem,  we  see  that 
a*(l)<a*(2)^a*(4)<a*(8)- 

a*(l)^a*(3)^a*(6)<a*(12)  •  •  • . 

But  a*(M)<a*(Ar2)  does  not  necessarily  hold  for  all  N\  <  A 2.  It  should  also  be  noted  that,  because  of  lifting, 
the  resulting  Q(P)  is  not  necessarily  invariant  for  the  original  system  at  each  step  (see  Fig.  2). 


4.  Performance  improvement 

Inherent  with  the  achieved  large  basin  of  attraction  is  however  the  low  convergence  rate.  To  improve  the 
convergence  performance,  we  can  use  the  idea  of  piecewise  linear  control  [15]  to  design  a  set  of  nested 
ellipsoids  Q(Pm)  C  Q(Pm-  1 )  C  •  •  •  C  fl(Pi )  C  Q(P0 ),  such  that  when  the  state  enters  an  inner  ellipsoid,  the 
controller  is  switched  to  another  feedback  which  makes  this  ellipsoid  invariant  with  an  increased  convergence 
rate.  Here  we  would  like  to  explore  the  possibility  of  further  increasing  the  overall  convergence  rate  by 
mayi'miying  the  convergence  rate  In  each  of  the  nested  ellipsoids.  The  nested  invariant  sets  can  be  simply 
chosen  by  setting 

Pi  =  PiPo,  l<Pl<fa<---<PM- 

The  convergence  rate  inside  Q(P)  under  a  feedback  u=Fx  can  be  measured  by  a  positive  number  c  <  1  such 
that 

(A  +  £F)tP(A  +  BF)  -  cP  <  0.  (16> 

We  note  that  such  F  and  c  always  exist  for  any  P  =P;  since  Po,  Po  an^  c=  1  satisfy  (16).  Smaller  c 
indicates  faster  convergence  rate.  Now  let  P  =  /JPo  be  fixed,  we  need  to  design  F  such  that  c  is  minimized. 
The  problem  can  be  stated  as  follows.  For  a  given  jS, 

min  c 

s.t.  (a)  fiPolf?^P>  i  =  (Q(fiPo)CL(F)),  (17) 

(b)  (A  +  BF)tP0(A  +  BF)  -  cP0  ^  0. 

We  denote  the  minimum  of  c  as  c*( jS).  For  the  lifted  N-step  controller  design,  we  can  replace  A,B  and  F  with 
A,B  and  P,  respectively.  As  in  the  previous  sections,  this  optimization  problem  can  also  be  put  into  the  LMI 
framework.  We  note  here  that  other  performance  criteria  can  also  be  formulated  into  a  similar  optimization 
problem  (see,  e.g.,  [14]). 

Proposition  1.  c*( /?)  is  decreased  as  P  is  increased.  If  B  has  full  row  rank,  then  there  exists  a  po  such  that 
c*{P)  —  0  for  all  P  >  Po- 
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Table  1 

The  increase  of  a *{N) 


N  1 

2  4 

8 

16 

32 

a*  (tf)  1.0650 

1.0930  1.1896 

1.4017 

1.5164 

1.5426 

Proof.  Constraint  (b)  in  (17)  is  equivalent  to 
P~{X'2\a  +  BF)JP0(A  +  BF)Pq{1/2)  <c/. 

Hence 

c*(p)=  min  ^ax[Po"(l/2>(^  +  BF)rPo(A  +BF)P0  (1/2)] 
s.t.  fiP<iXfi  <  ft  i  =  1> 2, . . . ,m. 

As  /?  is  increased,  the  constraint  fiPo'f?<P  becomes  less  restrictive,  hence  c*{p)  will  decrease. 

If  B  has  full  row  rank,  then  there  exists  Fx  such  that  A  +  BFX  =  0.  Let  the  ith  row  of  Fx  be  fu.  Let 
p0=max{fuPolfl  :i  =  1,2 then  for  all  jS  >  ft>,  c*(P)  =  0.  □ 


Usually,  for  system  (1),  B  does  not  have  full  row  rank.  For  the  lifted  system  (10),  if  (A,B)  is  controllable, 
then  B  will  have  full  row  rank  when  N^n.  We  will  see  in  the  examples  that  the  lifting  design  method  is 
efficient  not  only  in  enlarging  the  linear  invariant  ellipsoid,  but  also  in  increasing  the  convergence  rate. 

Now,  let  1  <  Pi  <  pi  <  •  •  •  <  Pm  be  a  sequence  of  numbers.  Denote  the  optimal  solution  of  (17)  corre¬ 
sponding  to  Pi  as  c*  and  F*.  A  switching  feedback  law  can  be  designed  as 

f  F0x(k)  if  x(k)  €  Q(Pfi)\Q(pxPa), 

F*x(k)  if  x(k)  €  £i(pxPo)\0(p2Po), 

u(k)  =  ( 


[  FtfX(k)  if  x(k)  e  Q(PmPo)- 

In  the  set  Q(PiPo)  \  Q(Pi+xPo),  the  convergence  rate  is  c*.  As  the  state  enters  the  inner  set  Q(Pi+xPQ)\ 
Q(Pi+2Po),  the  convergence  rate  is  increased  to  c*+1. 


5.  Examples 


Example  1.  Consider  a  second-order  system  in  the  form  of  (1)  with 

_  f  0.95 10  0.5408  1  _  [  0.0980 1 

A~  -0.2704  1.7622,  ’  0.5408  ' 

A  has  two  unstable  eigenvalues  {1.2214,  1.4918}.  The  reference  set  Xv,  =  {x  £  R2:xTf£x^l},  where 


R  = 


_  [  1.2862 


-1.0310 


-1.0310] 

4.7138 


is  chosen  according  to  the  shape  of  the  null  controllable  region.  Table  1  shows  the  computational  result  for 
am(N),N=  1,2,4,8,16,32. 

Fig.  1  shows  the  effectiveness  of  the  lifting  design.  The  innermost  curve  is  the  boundary  of  a*(l)ATR.  For 
JV  =  2,4, 8, 16,32,  the  set  a *(W)ZR  grows  bigger.  The  outermost  curve  is  the  boundary  of  the  null  controllable 
region  obtained  by  the  method  proposed  in  [8]. 

We  see  that  the  increase  from  a*(16)  to  a*(32)  is  small  so  we  take  N  =  16  as  the  lifting  step.  Now  we 
design  for  the  16-step  lifted  system  a  set  of  nested  invariant  ellipsoids  to  accelerate  the  convergence  rate.  The 
optimal  Pq  corresponding  to  a*  (16)  is 


Po  = 


[ 


0.5593 

-0.4483 


-0.4483  ] 
2.0497 


=  0.43487?  = 


1 


(oc*(16)) 


r  R. 
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Fig.  1.  The  sets  ot*(N)XK. 


Fig.  2.  The  deadbeat  control. 


So  Q(Po)  =  a*(16)AfR.  The  optimal  feedback  is 

-t  T  0.3504  0.4636  0.6129  0.7324  0.7279  0.6374  0.5467  0.4777 

Fo  =  _i.4294  -1.3917  -1.2360  -0.8490  -0.2872  0.1679  0.4481  0.6167 

0.4279  0.3918  0.3653  0.3454  0.3302  0.3185  0.3094  0.3021] 

0.7225  0.7924  0.8406  0.8750  0.9003  0.9193  0.9337  0.9447 

The  eigenvalues  of  A+BF  are  0.2758  ±j0.8814,  which  indicates  a  low  convergence  rate. 

We  take  /?  =  1.04, 1.08, 1.1,  and  get  the  corresponding  as  0.2650,0.005,0.  This  shows  that  the  con¬ 
vergence  rate  is  accelerated.  The  fact  that  c*(l.l)  =  0  implies  that  all  the  states  in  Q(l.LPo)  can  be  steered  to 
the  origin  in  16  steps  (counted  for  the  original  unlifted  system)  by  a  linear  feedback  controller.  The  deadbeat 
feedback  matrix  is 

-t  \  0.3115  0.4671  0.6665  0.7789  0.7236  0.6235  0.5433  0.4864 

Fo  =  -1.4990  -1.4655  -1.2419  -0.6839  -0.0779  0.3118  0.5342  0.6662 

0.4461  0.4170  0.3953  0.3788  0.3659  0.3555  0.3470  0.33981 
0.7494  0.8047  0.8428  0.8697  0.8887  0.9020  0.9110  0.9164 

Fig.  2  illustrates  this  design  result,  where  the  innermost  ellipsoid  is  0(1.  lPo)  and  the  larger  ellipsoid  is 
Q(Pq')  =  a*(16)ArR.  The  outermost  curve  is  the  boundary  of  the  null  controllable  region.  The  initial  states 
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Fig.  5.  a* (32)*Ran  d  the  null  controllable  region* 


on  the  boundary  of  fl(l.LP0)  are  marked  with  They  are  all  driven  to  the  origin  by  the  linear  feedback 
control  in  16  steps.  Fig.  2  also  shows  some  trajectories  of  the  unlifted  system  under  this  16-step  control  law. 

Example  2.  Consider  a  third-order  system  in  the  form  of  (1)  with 


"1.1972 

1.0775 

0 

'  1.4431 ' 

0 

1.1972 

0 

,  B  = 

0.9861 

0 

0 

1.4333 

1.0833 

All  of  the  eigenvalues  of  A  are  unstable.  For  the  purpose  of  comparison,  we  choose  18  points  on  the  boundary 
of  the  null  controllable  region  as  the  vertices  of  Ar  (see  Fig.  3),  where  the  vertices  of  Xr  are  marked  with 
and  the  vertices  of  the  null  controllable  region  are  marked  with  V.  Table  2  shows  the  computational  result 
for  a*(N),  N  =  1,2,4, 8, 16,32. 

We  also  see  that  a*(N)  increases  significantly  as  A  is  increased.  (See  Fig.  4  for  the  vertices  of  (**(1)4* 
and  Fig.  5  for  the  vertices  of  <x*(32)Xr,  both  in  comparison  with  the  null  controllable  region.) 


6.  Conclusions 

We  have  proposed  an  LMI-based  approach  to  the  maximization  of  the  linear  invariant  ellipsoid  for  linear 
systems  under  saturated  linear  feedback.  The  proposed  approach  applies  to  both  continuous-  and  discrete-time 
systems.  For  discrete-time  systems,  we  also  showed  that  the  lifting  technique  can  be  used  to  further  enlarge 
the  basin  of  attraction.  Finally,  the  low  convergence  rate  inherent  with  the  large  basin  of  attraction  is  increased 
by  switching  feedback  laws  between  a  sequence  of  nested  invariant  ellipsoids.  Two  examples  are  worked  out 
to  demonstrate  the  effectiveness  of  the  proposed  design  techniques. 
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Abstract 

The  Lp  input  to  state  stabilizability  of  affine  in  control  nonlinear  systems  subject  to  actuator 
saturation  is  examined.  A  few  sets  of  conditions  under  which  the  system  is  (finite  gain)  Lp 
input  to  state  stabilizable  are  identified  and  the  stabilizing  feedback  laws  are  explicitly 
constructed.  ©  2000  The  Franklin  Institute.  Published  by  Elsevier  Science  Ltd.  All  rights 
reserved. 

Keywords :  Nonlinear  systems;  Actuator  saturation;  Input  output  stabilization;  Lyapunov  analysis 


1.  Introduction 

Recently,  there  has  been  a  surge  of  interest  in  control  systems  with  saturating 
actuators.  This  surge  of  interest  has  led  to  many  fundamental  results  (see,  for 
example,  [1,2]  and  the  references  therein).  Most  of  these  results  however  pertain  to 
linear  plants.  In  this  paper,  we  continue  some  previous  efforts  on  the  stabilization  of 
nonlinear  systems  with  saturating  actuators.  More  specifically,  we  consider  the 
following  affine  in  control  nonlinear  system  subject  to  actuator  saturation: 

x  =/  (x)  +  g(x)e{u),  xeRn,  ueU,  (1) 
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where/ :  R"  — ►  R"  and  g:  R"  -*  R”  are  smooth  functions  with/  (0)  R  — ►  R 

is  the  standard  saturation  function  defined  as  follows: 

f  1  if  u  >  1, 

a(u)  =  <  u  if  |«|<1,  (2) 

[-1  if  u<  —  1. 

Under  the  assumption  that  the  free  dynamics 

x-f(x)  (3) 

is  Lyapunov  stable,  system  (1)  has  been  well  studied  in  the  context  of  global 
asymptotic  stabilization,  both  with  and  without  actuator  saturation.  For  the  case 
that  /  (x)  =  Ax  and  g(x)  =  Bx  +  N,  system  (1)  reduces  to  a  bilinear  system  and  its 
asymptotic  stabilizability  via  smooth  state  or  bounded  state  feedback  was 
investigated  by  Gauthier  and  Kupka  [3].  In  particular,  Gauthier  and  Kupka 
identified  a  set  of  sufficient  conditions  for  global  asymptotic  stabilization  using  the 
Jurdjevic  and  Quinn  technique  [4],  More  recently,  Lin  [5—7]  established  conditions 
under  which  the  general  nonlinear  system  (1)  is  globally  asymptotically  stabilizable. 
Under  these  conditions,  bounded  feedback  laws  were  constructed  to  achieve  global 
asymptotic  stabilization. 

The  objective  of  this  paper  is  to  examine  the  problem  of  external  stabilization 
of  system  (1).  To  define  this  problem,  we  recall  the  definitions  of  L"  space  and  Lp 
norm. 

Definition  1.  Suppose  x  G  R". 

1.  For  any  p  G  [1,  oo),  the  signal  space  Lnp  is  defined  as 

L*.  =  ^ x(t)  :  R+  — ►  R"  ^  |jc(t)|p  dr<oo^  , 
p  1=0 

where  |  •  |  represents  Euclidean  norm.  The  signal  space  ££,  is  defined  as 
L Zc  =  ^x(t) :  R+-»R”  sup  \x(t)\ <oo^  . 

2.  For  any  p  G  [1,  oo),  the  Lp  norm  of  any  signal  xeL”  is  defined  as 

r  rco  I  I/P 

I  ML,  =  1  1  MOI'd'1  . 

'  r=0 

The  Loo  norm  of  any  signal  x  G  is  defined  as 
IML  =sup|x(/)|. 

In  the  event  that  n  =  1,  we  denote  Lp  simply  as  Lp. 

We  define  some  notions  of  stabilizability  to  be  discussed  in  this  paper  as 
follows. 


(6) 

(7) 


(4) 

(5) 
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Definition  2  (Lp  to  state  stabilizability).  System  (1)  is  said  to  be  Lp  input  to 
state  stabilizable  by  state  feedback,  for  some  /?€  [l,oo],  if  there  exists  a  state 
feedback  law  u  =  <j)(x)  with  (f>{ 0)  =  0  such  that  the  closed-loop  system 

x  =f  (x)  +  g{x)<r{<t>(x)  +  v),  x(0)  =  0  (8) 

has  the  following  property: 

jc  €  Lnp,  Vv  €  Lp ,  (9) 

where  v  is  the  external  input  such  as  a  disturbance.  Furthermore,  the  system  is  said  to 
be  finite  gain  Lp  input  to  state  stabilizable  if  for  the  closed-loop  system  (8), 

ll*M?IMIv  VveLP)  (io) 

for  some  0. 

Definition  3  {Semi-global  stabilizability ).  System  (1)  is  said  to  be  semi-globally 
stabilizable  if,  for  any  bounded  (arbitrarily  large)  set  Xq  e  R",  there  exists  a  feedback 
law  u  =  cpx0  (x)  such  ^at  the  equilibrium  x  =  0  of  the  closed-loop  system 

•*  =/  (x)  +  g{x)ff(<t>x #(x))  (11) 

is  locally  asymptotically  stable  with  Xo  contained  in  its  domain  of  attraction. 

Several  recent  papers  have  investigated  this  problem  for  linear  systems  subject  to 
actuator  saturation,  a  special  case  of  (1), 

x  =  Ax  +  Bo(u).  (12) 

These  investigations  have  led  to  a  rather  clear  understanding  of  the  problem.  More 
specifically,  it  was  shown  by  Liu  et  al.,  [8]  that  system  (12)  is  finite  gain  Lp  input  to 
state  stabilizable  via  linear  feedback  if  (A,B)  stabilizable  and  A  is  Lyapunov  stable, 
that  is,  all  the  eigenvalues  of  A  are  in  the  closed  left-half  plane  with  those  on  they  co- 
axis  having  Jordan  blocks  of  size  1.  More  recently,  it  was  shown  in  [9]  that  the  system 
(12)  is  finite  gain  Lj  input  to  state  stabilizable  via  nonlinear  feedback  without  any 
conditions  on  the  open-loop  system  matrix  A.  For  a  more  detailed  account  of  these 
results,  see  [10]. 

Despite  the  recent  understanding  of  finite  gain  Lp  input  to  state  stabilization  of  the 
linear  system  subject  to  actuator  saturation  (12),  the  issues  related  to  its  nonlinear 
counterpart  (1)  have  not  been  carefully  examined.  This  paper  makes  an  attempt  to 
study  the  problem  of  input  to  state  stabilizability  of  system  (1)  with  stable  free 
dynamics.  We  will  identify  a  few  sets  of  sufficient  conditions  under  which  the  system 
is  Lp  input  to  state  stabilizable  or  finite  gain  Lp  input  to  state  stabilizable.  Under 
these  conditions,  feedback  laws  are  also  explicitly  constructed. 

The  organization  of  this  paper  is  as  follows.  Section  2  recalls  some  results  from  [7] 
concerning  global  asymptotic  stabilizability  of  system  (1).  These  results  serve  as  our 
motivating  references  for  some  of  our  main  results  to  be  given  in  Section  3.  A  brief 
concluding  remark  is  made  in  Section  4. 
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2.  Preliminaries  and  motivation  of  the  problem 

To  begin  with,  we  first  introduce  some  notations.  Throughout  this  paper,  let  /  ( x ) 
and  g(x )  be  smooth  vector  fields  in  R",  and  V :  R"  — ►  R+  be  a  smooth  function. 
Then  Lie  derivative  Lg  V  is  defined  by 

Lgnx)=^-g{x)  (i3) 

and  Lie  bracket  [/,g],  which  is  again  a  smooth  vector  field,  is  defined  by 

™ -&-%*■  <i4> 

The  following  notation  for  higher-order  Lie  brackets  will  also  be  used: 

adfg  =  g,  ad/g  =  [f,g],  adj+lg  =  [/, adfkg],  k  =  0,  1, ... .  (15) 

Now  we  consider  system  (1)  with  its  free  dynamics  satisfying  the  following 
assumption. 

Assumption  1.  For  the  free  dynamics  (3),  there  exists  a  Cr  (r^l)  function 
K  :  IFS"  — ^  R+,  which  is  positive  definite  and  proper  on  R”,  such  that 

L/K(x)<0,  Vxel T.  (16) 

That  is,  the  free  dynamics  (3)  is  globally  stable  in  the  sense  of  Lyapunov. 

With  the  vector  fields  /  and  g ,  we  define  the  distribution 

D  —  span  {adfg  :  Q^k^n  -  1}  (17) 

and  two  sets  associated  with  D: 

Q  =  {xenn  :  L)v  =  0,  k=\,...,r}  (18) 

and 

S'  =  {*  €E  IR"  :  LkfLxV{x)=  0,  Vt  6  D,k  =  0, . . .  ,r -  1}.  (19) 

The  following  theorem  concerning  global  asymptotic  stabilization  of  (1)  is  recalled 
from  [7]. 


Theorem  1.  Under  Assumption  1,  system  (1)  is  globally  asymptotically  stable  if 
QOS  =  {0}.  Moreover ,  a  stabilizing  feedback  law  is  given  by 


u^~LgV(x). 


(20) 


In  the  case  of  a  linear  system  (12),  the  conditions  of  Theorem  1  reduces  to  the  facts 
that  all  eigenvalues  of  A  are  in  the  closed  left-half  plane  with  those  on  the  yco- axis 
having  Jordan  blocks  of  size  1  and  that  the  pair  ( A,B )  is  stabilizable.  In  this  case, 
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without  loss  of  generality,  we  can  assume  that  the  pair  (A,B)  is  in  the  following 
form: 


0  1 
A.  ’ 


(21) 


where  all  eigenvalues  of  A-  €  K"~ xn“  have  negative  real  parts  and  A0  e  R”°xn°  is 
skew  symmetric,  i.e.,  Ao  +  Aq  =0.  Moreover,  the  pair  (Ao,  Bq)  are  controllable. 
Clearly,  subsystem 

xq  =  A0x0  +  B0<r(u)  (22) 

satisfies  the  conditions  of  Theorem  1  with  V  =  xJxo,I2  =  R"°  and  S  =  {0}.  Noticing 
the  fact  that  the  subsystem 

X-  =  A-X-  +  B-o{u)  (23) 

is  an  asymptotically  stable  linear  system,  we  conclude  from  Theorem  1  that  a 
globally  asymptotically  stabilizing  feedback  law  is  given  by 

u  =  -LBoV(x0)  =  -2Bt0x0.  (24) 

It  was  also  shown  in  [8]  that  the  feedback  law  (24)  also  achieves  finite  gain  Lpinpu  t 
to  state  stabilization  for  (12),  a  linear  system  subject  to  actuator  saturation.  The 
implication  of  these  discussions  is  the  following:  for  a  linear  system  subject  to 
actuator  saturation,  the  conditions  of  Theorem  1  ensure  both  global  asymptotic 
stability  and  finite  gain  Lp  input  to  state  stabilizability.  The  following  proposition 
and  example  show  that,  for  general  affine  in  control  nonlinear  system  (1),  the 
conditions  of  Theorem  1  do  not  always  imply  Lp  input  to  state  stabilizability.  This 
motivates  further  investigation  into  the  problem  of  Lp  input  to  state  stabilizability 
for  general  affine  in  control  nonlinear  system  (1). 


Lemma  1.  Let  g:  R"  ->  R",  n  >  1,  be  continuous.  If  {x :  xTPg(x)  =  0}  =  {0}  for 
some  P  >  0,  then  g(0)  =  0. 


Proof.  Without  loss  of  generality,  assume  P  =  I.  If  P  I,  this  condition  could  also 
be  met  by  redefining  x,  P  and  g.  We  prove  this  lemma  by  contradiction.  Assume  that 
g(0)  f  0.  Then,  there  is  at  least  one  element  of  g(0)  which  is  nonzero.  Without  loss  of 
generality,  assume  that  gi(0)  >  0,  where  gi(x)  is  the  first  element  of  vector  g(x).  By 
continuity  of  g(x)  at  x  =  0,  there  exists  a  5  >  0  and  a  neighborhood  Jf{0,  r),  r  >  0,  of 
the  origin,  such  that  gi(x)>8,  Vx  <=  A"(0,r).  Clearly,  xi  =  [r/2,  0,  0, . . . ,  0] 
eM(0,r)  and  hence  xJg(x\)'^8r/2  >  0.  Similarly,  xi  =  — X]  G  M(Q,r)  and  hence 
jcjg(x2)<  -  8r/ 2<0.  By  continuity  of  g(x)  and  the  fact  that  n>  1,  there  exists  an 
x  0  such  that  xTg(x)  =  0.  □ 


Proposition  1.  Consider  system  (1)  with  n>  1.  Assume  that  the  conditions  of 
Theorem  1  is  satisfied  with  V  =  xTPx,  where  P  >  0.  Also  assume  that  S  C  {x  €  IR”  : 
LgV(x)  =  2 xTPg{x)  =  0}  =  {0}.  Then,  the  feedback  law  u  =  -LgV(x)  also  achieves 
finite  gain  Lp  input  to  state  stabilization. 


696 


X.  Bao,  Z.  Lin  /  Journal  of  the  Franklin  Institute  337  (2000)  691-712 


Proof.  Lemma  1  shows  that  g(0)  =  0.  Hence,  the  closed-loop  system  is  trivially  finite 
gain  Lp  input  to  state  stable.  □ 

Example  1.  Consider  the  following  system  in  the  form  of  (1): 
x  =  e'xor(w)J  x  e  R. 

The  conditions  of  Theorem  1  hold  with  V  =  x2/2  and  S  =  {0}.  Hence,  the  feedback 
law  u  =  -xqx  achieves  global  asymptotic  stabilization.  However,  the  closed-loop 
system 

x  =  e*ff(-xex  +  v),  (26) 

where  v  is  the  actuator  disturbance,  is  not  finite  gain  Lx  stable.  To  see  this,  let 
v(r)  =  -2  6  Loo-  Since  |xex|  s$e_1,  VxsjO,  the  closed-loop  system  behaves  as 

x  =  -ex,  x(0)  =  0,  (2?) 

Hence,  x(t)  =  —In  (t  +  1)  ^  L 


3.  Main  results 

Consider  system  (1).  We  will  present  a  few  sets  of  sufficient  conditions  for  system 
(1)  to  be  Lp  input  to  state  stabilizable  or  finite  gain  Lp  input  to  state  stabilizable. 

To  present  these  sufficient  conditions,  we  need  some  preliminary  results.  First,  the 
following  lemma  gives  conditions  under  which  the  linearized  system  (/'(0),g(0))  is 
controllable,  where/ '(0)  is  the  first  derivative  of  /  (x)  with  respect  to  *  at  x  =  0. 

Lemma  2.  If 

Rank  £>1^  =  Rank  span  {adfkg  :  O^k^n  -  1}|X=0  =  n,  (28) 

then  the  pair  (f'(0),g(0))  is  controllable. 


Proof.  It  follows  from  a  straightforward  rank  check  of  the  controllability  matrix  of 

(/'( 0),*(0)).  □ 

We  recall  from  [6]  the  following  controllability-like  condition: 

dim  D  =  dim  span  {adkg :  0 —  1}  =  n,  Vx  €  IR”  \  {0}.  (29) 

In  [6],  it  was  shown  that  affine  in  control  nonlinear  system  is  asymptotically 
stabilizable  when  the  free  dynamics  of  the  system  is  stable  and  this  controllability¬ 
like  condition  is  satisfied.  However,  the  following  example  shows  that  this 
controllability-like  condition  does  not  imply  controllability  of  the  linearized  system 

(/m*(o)). 
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Example  2.  Consider  system  (1)  with 

TO  0  0]  |*T*1 

/  (x)  =  Ax  =  |  0  0  llx,  g(x)=  I  0 

'o  -1  O'  1  1 

For  this  pair  of  (/  (x),g(jt)),  we  have, 


(30) 


f  dg  d{{dg  dx)  Ax  -  Ag)  .{dg  .  \  1 

dim  D  =  dim  span  '  g,  -^-Ax  -  Ag,  — — - — - —Ax  -  A  -Ax-  Ag' 

ox  ox  dx 


fxT;cl  [2xT1 


=  dim  span 


/ 


0 

°  1 

1 

0  ‘ 

r, -Ag,A2g} 

r*T*i 

r  o  i 

° 

> 

|-i.l 

1 

0  ‘ 

dAg 
'  dx 


Ax  +  A2g 


\ 

J 


-I'J 


3,  Vx  6  R3  \  {0}. 


(31) 


However,  (A,  g( 0))  is  not  controllable. 


The  next  lemma  characterizes  some  conditions  under  which  the  system 

x=f(x)  +g(x)u  (32) 

is  globally  asymptotically  stable  and  locally  exponentially  stable. 


Lemma  3.  Consider  system  (32).  Assume  that  the  following  conditions  are  satisfied: 

(a)  Assumption  1  holds  with  a  V  that  also  satisfies 

^  =  k(x)xr  (33) 

for  some  k(x)^  0  with  fc(0)  >  0; 

(b)  dim  D  —  dim  span  {adfg  :  O^k^n  -  1}  =  Vx  €  R”; 

(c)  /  ^0)  is  skew  symmetric. 

Then ,  the  closed-loop  system  under  the  state  feedback  u  =  —  LgV  =  —k(x)g(x)T  x  is 
globally  asymptotically  stable  and  locally  exponentially  stable. 


Proof  of  Lemma  3.  Conditions  (a)  and  (b)  implies  global  asymptotic  stability  of  the 
closed-loop  system  (7],  By  Lemma  2,  Condition  (b)  implies  the  controllability  of  the 
linearized  system  (/'(0),<g-(0)).  Local  exponential  stability  of  the  closed-loop  system 
then  follows  from  the  exponential  stability  of  its  linearized  system 

X~f  '(0)x  -  &(0)g-(0)g(0)Tx,  (34) 


which  in  turn  is  due  to  Conditions  (b),  (c)  and  k( 0)  >0.  □ 
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Remark  1.  Note  here  that  condition  (33)  is  not  as  restrictive  as  it  appears  to  be.  For 
example,  for  the  first-order  system,  if  V  is  Cr(r  >  1)  function,  it  is  satisfied  as  long  as 
dF(x)/dx|  =  0.  For  highef-order  systems,  it  can  be  satisfied  if  V(x)  =  Fi(|x|),  for 
some  function  V\,  and  AV{x) / dx\x=fi  =  0. 

In  what  follows,  we  recall  a  converse  Lyapunov  theorem  [11]. 

Lemma  4.  Consider  the  autonomous  system 

x=f(x).  (35) 

If  the  equilibrium  x  =  0  is  globally  asymptotically  stable  and  locally  exponentially 
stable ,  then  for  any  p  £  (l,oo)  there  exists  a  function  V(x)  such  that 

(36) 


a|xp<F(x)<a(|x|)|x|p, 

f)V 

—/(*)«$  -clxp, 


(37) 


dv 


dx 


<«M)M 


i  p~\ 


(38) 


where  a  and  c  are  some  positive  scalars ,  and  a(-)  and  /?(-)  are  positive  monotonically 
nondecreasing  continuous  function  on  [0,  oo).  Moreover ,  in  the  absence  of  global 
asymptotic  stability ,  (37),  (38)  will  hold  within  the  domain  of  attraction . 

Finally,  we  recall  from  [12]  the  following  lemma. 

Lemma  5.  Let  £  and  (  be  two  positive  scalars.  For  any  p  >  l  >  0,  there  exists  two 
scalars  M\ ,  Mj  >  0  such  that 

+  M2ip  ^ 

and  consequently ,  for  any  n  >  0  and  k  >  0, 

e~lC  Ml  K"<f  +  Kn{l-p)/,M2(p.  (40) 

We  are  now  ready  to  present  our  first  result  on  Lp  input  to  state  stabilizability  of  the 
system  (1). 

Theorem  2.  Consider  system  1.  Assume  that  the  following  conditions  are  satisfied. 

1.  Assumption  1  is  satisfied  with  a  V  that  also  satisfies 


8_ 

dx 


V(x)  =  fc(x)xT, 


where  k(x)  5=0,  k( 0)  >  0. 


(41) 
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2.  /'(O)  is  skew-symmetric  and  dimZ)  =  dim  span  {adfg  :  0 —  1}  =  n, 
Vx  €  R". 

3.  There  exists  ag:  R"  -♦  R+  with  |g(x)|<^(x),Vx  e  R",  such  that  for  some  positive 
real  number  6, 

m)g(x)^e(l  +  \xf),  5  €[0,1],  (42) 

where  /?(•)  is  as  defined  in  Lemma  4  for  system  x  =f  (x)  —  g(x)LgV,  and  ifn>  1, 
d[g(x)k(x)Xi}^d[^(x^  n  (43) 

8xj  aki 

Then,  if  5  6  [0,  1),  system  (1)  is  Lp  input  to  state  stabilizable for  any  p  e  ( 1,  oo \,an  d  if 
5  =  1,  system  (1)  is  Lp  input  to  state  stabilizable  for  any  p  6  (1,  oo).  Under  the  above 
conditions,  the  feedback  law  u  =  -LgV  achieves  global  asymptotic  stability  and  Lp 
input  to  state  stability  simultaneously. 


Remark  2.  The  reason  for  introducing  g(x)  is  to  increase  the  possibility  of  satisfying 
both  (42)  and  (43).  Suppose  for  some  system,  g(x)  =  [2xi  x2]T,  k(x)  =  1  and  (42)  is 
satisfied  with  g(x)  =  |g(x)|.  But  (43)  cannot  be  satisfied  with  this  choice  of  g(x).  If, 


however,  we  let  g(x)  =  2-  lx\  +xj  and  suppose  (42)  is  also  true  for  the  new  g(x),  it  is 
easy  to  see  that  |g(x)|  <g(x)  and  (43)  is  also  satisfied. 


Proof.  Under  the  state  feedback  u  =  -LgV,  the  closed-loop  system,  in  the  presence 
of  the  external  input  v,  is  written  as  follows: 


•*=/(*)+  g(x)ff(~Lg  v  +  v) 

=f  (x)  - g(x)LgV  +  g(x)LgV  +  g(x)o(-LgV  +  v) 

-f(x)  -  g(x)LgV  —  g(x){x  -  o{x))  +  g(x)v,  (44) 


where  x  =  —Lg  V  +  v. 

By  Lemma  3,  Conditions  1  and  2  imply  that  the  closed-loop  system  (44)  in  absence 
of  saturation  and  disturbance  v,  which  is 

x=f(x)-g{x)LgV  (45) 

is  globally  asymptotically  stable  and  locally  exponentially  stable. 

Lemma  4  then  shows  that,  for  any  p  e  (1,  oo),  there  exists  a  function  Vfx)  such 
that, 

a|x|p<Fi(x)^a(|x|)|x|p,  (46) 


dVx 

dx 


{f{x)-g{x)LgV)^-c\xf, 


(47) 


^m)\x\p~\  (48) 

where  a  and  c  are  some  positive  scalars,  and  a(-)  and  /?(•)  are  positive  monotonically 
nondecreasing  continuous  function  on  [0,oo). 


8VX 

dx 
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Hence,  the  derivative  of  V\  along  the  trajectories  of  (44)  is  bounded  by 
V\ -  c|j(f  +  fi{\x\)\xr' \s{x)\xa(x)  +  £(|x|)|x|p_1  |g(x)||  v| 

<  -  c|x|p  +  jSdxDIxf'^x)^^)  +/?(|x|)|x|/’“1|(j:)|vi.  (49) 

For  the  case  that  n~  1,  define 

V2(x)=  1*  p(\z\)\z\p-'g{z)k(z)zdz.  (50) 

0 

For  the  case  that  n  >  1,  define 

V2(x)=  r  Y'j8(|z|)|z|/,_1g(z)fc(z)z/dzI-.  (51) 

o  ,=i 

Note  that  V2  is  well  defined  due  to  (43).  The  partial  derivative  of  V2  is  then  given  by 

^-V2(x)  =  P(\x\)\x\p~lg{x)k{x)xT  (52) 

and  V2(x)  is  nonnegative  since  k(x)  ^  0  for  any  x  €  IR". 

Now  the  derivative  of  V2  along  the  trajectories  of  (44)  is  bounded  as  follows: 

K2^jS(|x|)|x|p"1g(x)A:(x)xTg(x)(7(x) 


-  P(\x\)\x\p  'g(x)xa(x)  +  p(\x\)\x\p  'g(x)|v|.  (53) 

Choosing  V3  —  V\  -f  V2  and  using  (42)  and  Lemma  5,  we  have 

v3<  -  c|xr  +  2^(|x|)|xr'g(x)|v|<  -c|x|'  +  20(l  +  |x|i)|xr,|v| 

<  -%x\P  +  »(1  +  (54) 

for  some  6  >  0. 

We  now  first  establish  the  theorem  for  p  €  (1,  oo). 

By  inequality  (46)  and  the  definition  of  V2,  function  V3  has  a  lower  bound, 
V3{x)>a\x\p,  Vx  6  R".  (55) 


where  a  is  as  defined  in  (46). 

Hence,  inequality  (54)  can  be  continued  as, 

K3^0(l  +  ^)|v|f’^20(l  +  F3)V|p 


for  some  6  >  0. 

Inequality  (56)  further  implies 


dVi 

(1  +  V3f 


<20|v|p  dr. 


(56) 


(57) 


Integrating  both  sides  of  (57)  from  0  to  t  and  noting  that  F3(x(0))  =  F3(0)  =  0,  we 
obtain, 
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(i)  if  <5  €  [0,  1), 

(1  +  F^f))1-5  <201^  <oo,  Vv  6  Lp.  (58) 

(ii)  if  8  =  1, 

ln(l  +  F3(f))^20||v||if<cx>,  Vv  e  Lp.  (59) 

Combining  these  two  cases,  we  conclude  that  for  any  v  G  Lp,  F3  is  bounded  by 
some  positive  real  number  depending  on  ||v||i;,  and  hence  |x|  is  bounded  by  some 
positive  real  number  depending  on  ||v||L  . 

Hence,  by  continuity  of  function  p(-)  and  g(-),  derivative  of  F3  along  the 
trajectories  of  (44)  is  bounded  by 

F3^-M1(||v||Li;)|^  +  M2(||v||/.f)|vf)  (60) 

where  Mi(||v||l  )  and  M2(||v|[i  )  are  positive  real  numbers  depending  on  ||v||if. 

Again  integrating  both  sicfes  of  (60)  from  /  =  0  to  oo  and  noting  that 
F3(x(0))  =  F3(0)  =  0  and  Vj(x(i))^0  for  any  t,  we  have, 

l  Ix^dtcoo,  Vv  £  Lp.  (61) 

o 

This  concludes  the  proof  of  the  Theorem  for  p  6  (l,oo). 

Next,  we  consider  the  case  that  p  =  oo.  To  this  end,  we  start  with  (54)  for  p  —  2. 
More  specifically,  we  have 

Vi  <  -  c\x\2  +  20|x||v|  +  20|x|1+*|v|.  (62) 


By  Lemma  6,  inequality  (62)  could  be  continued  as  follows: 

^-cixp  +  eKIMlL  +  IMlff^).  v^Loo, 

for  some  c,  >  0.  - - 

Hence  V3  is  negative  outside  the  ball  with  radius  *  '(Q\  fc)  (IM)^  + 

Let  Vm  be  the  maximum  of  V3  inside  this  ball,  then  ^(*(0)^  Vm  for  any  t^0. 
Inequality  (46)  now  implies  that 

|x|2<-  F,(x)<-(F,(x)  +  F2(x))  =  -F3(x)<-Fa,.  (64) 

a  a  a  a 

This  completes  the  proof.  □ 

We  next  establish  some  other  sets  of  sufficient  conditions  for  (finite  gain)  Lp  input 
to  state  stability  of  (1).  These  sets  of  conditions  are  weaker  than  those  of  Theorem  2 
and  some  even  allow  for  stronger  stabilization  result.  However,  the  stabilizing 
feedback  laws  under  these  conditions  only  achieve  semi-global  or  local  asymptotic 
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stability  instead  of  global  asymptotic  stability.  For  simplicity  in  the  presentation,  we 
will  restrict  ourselves  to  the  Li  case. 

We  first  establish  the  following  preliminary  result. 


Lemma  6.  Consider  system  (1)  under  the  feedback  law 


u  — 


-LgV- 


LgV 


(65) 


where  V  is  defined  in  Assumption  1  and  k  >  0  is  a  design  parameter.  Then ,  L°v(\/k)  = 
{x  :  V  <  1  /k}  is  an  invariant  set ,  that  is,  any  trajectory  that  starts  from  inside  this  set 
will  remain  inside. 


Proof.  The  closed-loop  system  is  given  by 

(  L  V  \ 

x=f(x)+g(x)o  —Lg V  —  - — 2  + V  ,  V£L2,  (66) 

1  -  (kV) 

where  v  is  actuator  disturbance.  Inside  the  set  Ly(  1/jc),  the  derivative  of  V  along  the 
trajectories  of  (66)  is  bounded  by 


V^LgvJ -LSV^  1  + 


1 


\  \ 


1-(kF)2 
^|v|,  then 


-f-  v 


(67) 


V^LSV^  J -LgV'  1  + 


+/-!/'  1  + 


<|v|,  then 

( 

V 

( 


1 


1  -  (kV)2 

i  \M 


\  \  t  T  /, 

+  v  —  <7  —Lg  V  1  + 


1 


\\ 


i  -  (i cvy 


i  -  w 


<|LgF||v|<(l-(KF)2)|v|2. 

Combining  the  two  cases,  we  get 
F<l-(KF)2)|v|2. 

Integrating  both  sides  from  0  to  t,  we  have 

1,  1  +KV(t)  1,  1  .+  kV(Xo)  f\  ,2 

1 M  <0°' 

which  implies  V(t)<l/K,  Vf,  for  any  v  e  L2. 


(68) 

(69) 


(70) 
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For  later  use,  we  note  that, 

1  >l|v|ll2  _  1 

F(/)< — ——2 -  for  x0  =  0  and  Vv  G  L2. 

Ke2K||v||iJ  +  1 


(71) 

□ 


We  are  now  ready  to  present  our  second  set  of  conditions  for  Lj  input  to  state 
stabilizability. 

Theorem  3.  Assume  system  (1)  satisfies  the  following  conditions'. 


1.  Assumption  1  is  satisfied  with  a  V  such  that, 

=  <72> 

where  k(x)  >  0  and  any  x  €  W  and  k(0)  >  0. 

2. f'(0)  is  skew-symmetric  and  dim  D  =  dim  span  {adjg  :  —  1}  =  n, 

Vx  €  R"; 

3.  Ifn  >  1,  there  exists  a  k*  >  0  such  that  for  all  x  €  L\{\/k),  Vjc  e  (0,  k*}, 

dk(x)(\  +  1/(1  -  (kF(x))2))x,-  _  dk(x)(l  +  1/(1  -  (kV(x))2))xj 

dxj  dXi  ’  (73) 

Then  system  (1)  is  L2  input  to  state  stabilizable.  Moreover ,  there  exists  a  family  of 
feedback  laws  that  achieves  semi-global  asymptotic  stabilization  and  L2  input  to  state 
stabilization  simultaneously. 


Proof.  We  prove  this  theorem  by  explicit  construction  of  feedback  laws.  The  family 
of  feedback  laws  we  construct  is  parameterized  in  k  >  0  and  is  given  by 


u  —  ~LS  V  — 


LgV 

1  -  ( KVf 


(74) 


By  Lemma  6,  level  set  L^(1/k)  is  invariant  with  v  =  0,  which  means  any  trajectory 
starting  from  inside  the  level  set  L°v(1/k)  will  stay  inside  for  ever.  Hence,  the 
equilibrium  x  =  0  of  the  closed-loop  system 

x=f(x)+  g{x)o r  ( -LgV  -  -  ■  (75) 

is  asymptotically  stable  and  LPv{\/k)  is  the  domain  of  attraction  [7],  Since  V  is  a 
proper  function  on  R",  by  decreasing  the  value  of  k,  we  can  include  any  bounded  set 
A’o  of  the  state  space  in  L°y(  1/tc).  This  shows  that  the  family  of  feedback  laws  (74) 
indeed  achieves  semi-global  stabilization. 

In  what  follows  we  show  that  the  same  family  of  feedback  laws  also  achieves  L2 
input  to  state  stabilization.  To  this  end,  we  consider  the  closed-loop  system  in  the 
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presence  of  external  input  v, 

j  =/ (*)  +  ?(*)» l -  t  Zuyji -Ltv  +  *' 

-m-ML.y'  i +7^  +*wv/'+ 7^7 

=  /fx) +  - — i— J  -f(x)|*-«(i)l+8(*)i’, 

1  -  (kV) 


(76) 


where  v  is  the  actuator  disturbance  and  x  =  —((1/(1  —  (kV)2))  +  \)LgV  +  v. 

By  Lemma  6,  L^(l/fc)  is  an  invariant  set  for  any  v  e  L2.  Moreover,  from  (71),  for 
any  given  v  e  £2, 


(\  e2K"<  -  l\ 
X£lV  K  e2«||<  +  l 


( 


x  6  IR"  : 


1  e2K||v|1^  -  l) 

Fs; - = -  . 

k  e^lHI^  1 


(77) 


By  Lemma  3,  Conditions  1  and  2  imply  that  the  equilibrium  x  =  0  of  system 

X  =f  (x)  4-  g(x)  ( -Lg  V  -  -  (78) 

is  locally  exponentially  stable  and  IPv{\/k)  is  its  domain  of  attraction.  By  Lemma  4, 
there  exists  V\  such  that,  for  x  e  L^(1/k), 

^ r / W  +  g(*)  f-Lg v -  t  1  <  -c|x|2,  (79) 


5Fi 


<j8(M)W, 


(80) 


where  c  >  0  and  jS:  R+  — >  R+  is  some  monotonically  nodecreasing  continuous 
function. 

Let  jx,b>  0  be  such  that 

(\  g&ii<  _  A 

|gW|Sf,.  «*)<»,  vxet.  •  (81) 


Hence,  the  derivative  of  Ki  along  the  trajectories  of  (76)  is  bounded  by 
Fi  <  -  c|x|2  +  P(x)\x\\g(x)\xa{x)  +  0(x)|x||g(x)||v| 

<  -  c|x|2  +  bn\x\x<x(x)  +  bg\x\\v\. 


(82) 
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For  case  n  =  1,  define 

V2=  l  \z\k(z)z^l+- — -3— d z.  (83) 

o  1  -  (kV(z)  ) 

When  n  >  1,  define 

V2(x)=  l  V>|fc(z/l+- —  1  Zi  dzi.  (84) 

o  /=i  1  -(kV(z)) 

Note  that  this  V2(x)  is  well  defined  due  to  Condition  3  of  the  theorem.  The  derivative 
of  V2  along  the  closed-loop  system  is  bounded  as  follows: 

?2<|*|*(*)^1  +7 — 7  ^  xrga{x)  =  -|  x\xfix)  +  |x||v|.  (85) 

1-(kF(W)) 

Now  define  V2  =  V\  +  bpV 2, 

V3^~  c]x\2  +  2bp\x\\v\  <  -  ^|*|2  +  ^-|v|2.  (86) 

Integrating  both  sides  from  t  =  0  to  oo,  and  noting  that  F3(x(0))  =  V3(0)  =  0  and 
V3(x(t))^0  for  all  t,  we  have 

IMIi20,IMIi2  (87) 

with  y  =  4bp/y/3c.  □ 


Now  we  give  a  simple  example  to  illustrate  the  result  given  in  Theorem  3. 


Example  3.  Consider  system 


x  = 


r  -*1 


+x2]  r  o  i 


(88) 


It  is  easy  to  verify  that  Conditions  1-3  in  Theorem  3  are  satisfied  with  a  function 
V  —  xj  +  for  any  k  >  0.  Then  the  family  of  feedback  laws  u  =  -LgV  -  (LgV / 
(1  —  (kV)2))  achieves  both  semi-global  asymptotic  stabilization  and  L2  input  to  state 
stabilization  simultaneously.  Fig.  1  shows  the  simulation  results  for  x(0)  =  (2,  1) 
and  a  disturbance  v  =  [l(t  -  5)  —  1(<  —  10)].  The  value  of  k  chosen  is  0.1. 


Our  next  set  of  condition  exploits  some  special  structures  of  g(x).  Here  we  will  see 
the  L2  gain  from  the  disturbance  to  the  state  is  finite  and  could  be  made  arbitrarily 
small  by  appropriate  choice  of  control  law. 


Theorem  4.  System  (1)  is  finite  gain  L2  input  to  state  stabilizable,  if 


1.  (/'(0),g(0))  stabilizable',  and 

2.  g(x)  is  in  the  form  of  g(x)  =  fix)B,  where  fix)  is  a  scalar  function  and  B  £  R”,  or 
g(x)  satisfies  g'(0)  =  0. 
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Fig.  1 .  Simulation  results  for  Example  3  with  k  —  0. 1 . 


Moreover ,  under  these  conditions ,  there  exists  a  feedback  law  that  simultaneously 
achieves  local  asymptotic  stability  and  finite  gain  Lj  input  to  state  stability  with  an 
arbitrarily  small  gain. 

Proof.  Design  the  state  feedback  law  as  follows: 

u  =  -S(0  <89> 

where  p  >  0  is  a  design  parameter  and  P  is  the  unique  positive-definite  solution  to 

Pf'( 0)  +  (/'(0))TP -  Pg(0)g(0)rp  =  -I.  (90) 

We  note  that  such  a  P  exists  because  (/'(0),g(0))  is  stabilizable. 

Under  this  feedback  law,  the  closed-loop  system  takes  the  following  form: 

*  =/  (*)  +  S(x)a  f-g(0)rPx  -  -—I—^g^Px  +  v\  (91) 

Choose  Lyapunov  function  candidate  V  =  xrPx,  the  derivative  of  V  along  the 
closed-loop  system  (91)  is  given  by 
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V  =  -|x|2  +  xTP[xT/i  "(ft  )x, . . . ,  xrfi  "(Zi)x, xT/„  "(<?„)x]T 


+  xTPg(0)g(0)TPx  +  2xt Pg{x)a  ^ - g{0)TPx  - 

i-^fmTrx+J  ’ 

(92) 

where 

\&Mi) 

&Mi) 

mm 

d2X\ 

dx\dxz 

dx\dxn 

&mt) 

&Mt) 

met 

fi'%)  = 

dx\dxj 

d2x2  " 

dx2dxn 

(93) 

d2md 

&m) 

d2/m 

dx\  dxn 

dx2dx„ 

d2x„ 

and  f,  =  [£n»--- 

<^]T  with  Zij 

€  [0)  Xy] ,  j 

=  1,- 

,.,n. 

In  the  case  that  g(x)  =  a(x)B,  (92)  is  continued  as 

V  =  —  |x|2  +  xTP[xT/i  "(£i )x, . . . , xTfi "(& )x, xTf„ "(£„)x]T 
+  xTPg(0)g{0)TPx  +  2xTP(a(0)P  +  a'(QxB) 

x/-s{o?Px-i_^Tpx?mrrx+-> 

<  -  |x|2  +  F(£)|x|3  +  xTPs(0)g(0)TPx  +  2xT P(cc(0)B  +  at(QxB) 

x  a  ( - g(0)TPx  -  -—L—-2g(0fPx  +  ,  (94) 


where  (  e  R”  with  €  [0, x,], /  =  I, . . .  ,n  and  F(-)  is  a  continuous  scalar  function. 
Let  k  >  0  be  such  that 

x  €  4(1/jc)  =*  F(^)|x|3  ^  |x|2/2,  |«'(C)x|  |«(0)|/2  and  |s(0)TPx|  «£  1. 

(95) 

Fix  k.  We  now  consider  (94)  inside  L°v(  1/k),  which,  by  Lemma  6,  is  an  invariant  set 
if  v  €  L2. 


If 


1  -  (kxtPx) 


rg(0  )TPx 


5*|v|,  then  V<0. 


If 


P 

1  -  (tcxtPx)2 


g(0)TPx 


<|v|,  then, 
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-  I|x|2  -  2xtP[cl(0)B  +  a'(C) xB) 

|  l  rp  n 

x  -a  -g(0)JPx- 


1  -  ( kxtPx )' 


:g{0)TPx  +  V^  -g(0)TPx 


^_Iw2  +  40-J!«^)|v|2 

z  p 

<-5W2+>2- 


(96) 


Integrating  both  sides  from  f  =  0  to  oo  and  noting  that  K(.x(0))  =  F(0)  =  0  and 
V(x(t))^  0,  we  conclude, 


[Z 

IWIz,<  -IML2>  VvGL2. 


(97) 


Moreover,  we  note  that  \/8  Jp  — »  0  as  p  — >  oo. 

In  the  case  when  g'(O)  =  0,  (92)  is  bounded  by 

V  =  - |x|2  +  ;tTP[xT/>  "(£i )*,..., xT/;- "(&)*> . . . , *T/« "(U*]T 

4-  xTPg(0)g(0)TP*  +  2xTP(g(0) 

+  [*V/(CiW2, . . .  ,*Ti?(W*/2,  ■  •  •  ,xTg"(Cfl)^/2]T) 

<  -  |x|2  +  <?($,  C)|*|3  +  xTPg(0)g(0)TPx 
+  2xTPg(0)<r  ^ —g(0)T Px  -  -—L-—gi0)TPx  +  ,  (98) 


where  (?(•)  is  some  continuous  scalar  function.  Let  k  >  0  be  some  sufficiently  large 
number  such  that 

x€40A)  =*<?(£,  0M3<M2/2  and  |g(0)TPx|<l.  (99) 

Fix  k.  Now  consider  (98)  inside  L^(1/k),  which,  by  Lemma  6,  is  an  invariant  set  in 
v  e  Z-2-  First  rewrite  (98)  as 

V  <  -  ^|x|2  +  xTPg(0)g(0)TPx 

+  2xTPg(0)<r  ^ —g(0)r  Px  -  y  _  ^r^g(0)TPx  +  . 
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If 


1  —  (k:xtjP;x:) 


;g(0)TPx 


5?|v|,then  V<0. 


If 


1  —  (kxtPx) 


2g(0fPx 


<|v|,  then 


F^-i|x|2-2xTP*(0) 

x  ^-</-g(0)TPx  -  -  -  j-^—^g{0)Tpx  +  —  g(0)TPx^ 

1.  i2  4(1  —  (kxtPx)2).  |2 

<  -  2^1  +  - —p - — M 

^-\\x\2+^\2- 

2  p 


(100) 


Integrating  both  sides  from  t  =  0  to  oo  and  noting  that  F(x(0))  =  F(0)  =  0  and 
V(x(t))^0,  we  conclude 

IMM  flMI*.  Vv  €  l2.  (ioi) 

Moreover,  we  note  that  \/8/p  — ►  0  as  p  —*  oo.  □ 

Now,  we  give  an  example  to  illustrate  the  result  in  Theorem  4. 


Example  4.  First,  we  consider  system 

F  x\  +  x2 1  T  0  1  ,  . 

x=  +  <>■(«)• 

XI  +  X2  (1  +  *2)  COS  *1 

It  is  easy  to  see  that  Conditions  1  and  2  are  both  satisfied  and 

,,  r  oi 

g(x)  =  a. {x)B  =  ( 1  +  x$)  cos  x,  . 


(102) 


From  the  proof  of  Theorem  4,  we  obtain  a  feedback  law  of 
«  =  -[1  +  p/(l  -  k2( 2.6955x?  +  4.8284x1X2  4-  3.6131x|)2)] 

x  (2.4142x, +3.6131x2).  (103) 

The  simulation  result  is  shown  in  Figs.  2  and  3,  where  the  disturbance  v  = 
[1  (f  —  5)  —  1  (f  —  10)]  and  the  initial  condition  (xi(0),X2(0))  =  (0.5, 0.1).  From  the 
simulation  we  can  see  the  effect  of  the  disturbance  v  on  the  state  x  is  indeed  reduced 
by  increasing  the  value  of  p. 


Control  u  State  x 
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Fig.  4.  Simulation  results  for  system  (104)  with  k  =  0.2,  p  =  10. 


Next,  we  consider  system 

..  rx? +X2I  r  x]  i  . 

■*1+^2  1  4-  Xj  +  X"2 


(104) 


It  is  easy  to  see  that  Conditions  1  and  2  are  both  satisfied  and  /(0)  =  0.  From  the 
proof  of  Theorem  4,  we  have  the  feedback  law  in  the  form  of 

u  =  -\1+p/(\-  k2(2.6955x?  +  4.8284xiX2  +  3.6131x^1 

x  (2.4142x1  +3.6131x2).  (105) 


The  simulation  result  is  shown  in  Fig.  4,  where  the  disturbance 
v  =  [1  (/  —  5)  —  l(f  -  10)]  and  the  initial  condition  (^i(0),x2(0))  =  (0.8,  0.3). 


4.  Conclusions 

In  this  paper  we  have  studied  the  external  stabilizability  of  affine  in  control 
nonlinear  systems  with  saturating  actuators.  A  few  sets  of  conditions  under  which 
the  system  is  Lp  input  to  state  stabilizable  or  finite  gain  Lp  input  to  state  stabilizable 
are  given.  Under  those  conditions,  the  stabilizing  feedback  laws  are  explicitly 
constructed.  Our  future  work  would  concentrate  in  further  relaxation  of  these 
conditions  and  establishing  their  counterparts  for  discrete-time  systems. 
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SUMMARY 

This  paper  investigates  the  problem  of  practical  stabilization  for  linear  systems  subject  to  actuator 
saturation  and  input  additive  disturbance.  Attention  is  restricted  to  systems  with  two  anti-stable  modes.  For 
such  a  system,  a  family  of  linear  feedback  laws  is  constructed  that  achieves  semi-global  practical  stabilization 
on  the  asymptotically  null  controllable  region.  This  is  in  the  sense  that,  for  any  set  Xo  in  the  interior  of  the 
asymptotically  null  controllable  region,  any  (arbitrarily  small)  set  x<x>  containing  the  origin  in  its  interior,  and 
any  (arbitrarily  large)  bound  on  the  disturbance,  there  is  a  feedback  law  from  the  family  such  that  any 
trajectory  of  the  closed-loop  system  enters  and  remains  in  the  set  in  a  finite  time  as  long  as  it  starts  from 
the  set  Xo •  In  proving  the  main  results,  the  continuity  and  monotonicity  of  the  domain  of  attraction  for 
a  class  of  second-order  systems  are  revealed.  Copyright  ©  2001  John  Wiley  &  Sons,  Ltd. 

KEY  WORDS:  nonlinearities;  semi-global  stabilization;  disturbance  rejection;  actuator  saturation;  limit  cycle; 
high  gain  feedback 


1.  INTRODUCTION 

We  consider  the  problem  of  controlling  an  exponentially  unstable  linear  system  with  saturating 
actuators.  This  control  problem  involves  issues  ranging  from  such  basic  ones  as  controllability 
and  stabilizability  to  closed-loop  performances  beyond  stabilization.  In  regard  to  controllability, 
the  issue  is  the  characterization  of  the  null  controllable  region  (or  the  asymptotically  null 
controllable  region),  the  set  of  all  initial  states  that  can  be  driven  to  the  origin  by  the  bounded 
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input  provided  by  the  saturating  actuators  in  a  finite  time  (or  asymptotically).  On  the  other  hand, 
the  issue  of  stabilizability  is  the  determination  of  the  existence  of  feedback  laws  that  stabilize  the 
system  within  the  asymptotically  null  controllable  region  and  the  actual  construction  of  these 
feedback  laws. 

It  turns  out  that  these  seemingly  simple  issues  are  actually  quite  difficult  to  address  for  general 
linear  systems.  As  a  result,  they  have  been  systematically  studied  only  for  linear  systems  that  are 
not  exponentially  unstable  (all  open-loop  poles  are  in  the  closed  left-hand-plane).  In  particular,  it 
is  now  well  known  [1-3]  that  if  a  linear  system  has  all  its  open-loop  poles  in  the  closed 
left-half-plane  and  is  stabilizable  in  the  usual  linear  system  sense,  then,  when  subject  to  actuator 
saturation,  its  asymptotically  null  controllable  region  is  the  entire  state  space.  For  this  reason, 
such  a  linear  system  is  usually  referred  to  as  asymptotically  null  controllable  with  bounded 
controls  (ANCBC). 

In  regard  to  stabilizability,  it  is  shown  in  Reference  [4]  that  a  linear  system  subject  to  actuator 
saturation  can  be  globally  asymptotically  stabilized  by  nonlinear  feedback  if  and  only  if  it  is 
ANCBC.  A  nested  feedback  design  technique  for  designing  nonlinear  globally  asymptotically 
stabilizing  feedback  laws  was  proposed  in  References  [5-7].  Alternative  solutions  to  the  global 
stabilization  problem  consisting  of  scheduling  a  parameter  in  an  algebraic  Riccati  equation 
according  to  the  size  of  the  state  vector  were  later  proposed  in  References  [8-10].  The  question  of 
whether  or  not  a  general  linear  ANCBC  system  subject  to  actuator  saturation  can  be  globally 
asymptotically  stabilized  by  linear  feedback  was  answered  in  References  [11, 12],  where  it  was 
shown  that  a  chain  of  integrators  of  length  greater  than  2  cannot  be  globally  asymptotically 
stabilized  by  saturated  linear  feedback. 

The  notion  of  semi-global  asymptotic  stabilization  (on  the  asymptotically  null  controllable 
region)  for  linear  systems  subject  to  actuator  saturation  was  introduced  in  References  [13, 14], 
The  semi-global  framework  for  stabilization  requires  feedback  laws  that  yield  a  closed-loop 
system  which  has  an  asymptotically  stable  equilibrium  whose  domain  of  attraction  includes  an 
a  priori  given  (arbitrarily  large)  bounded  subset  of  the  asymptotically  null  controllable  region.  In 
References  [13, 14],  it  was  shown  that,  for  linear  ANCBC  systems  subject  to  actuator  saturation, 
one  can  achieve  semi-global  asymptotic  stabilization  by  using  linear  feedback  laws. 

In  an  effort  to  address  closed-loop  performances  beyond  large  domain  of  attraction,  [15] 
formulates  and  solves  the  problem  of  practical  semi-global  stabilization  for  ANCBC  systems  with 
saturating  actuators.  In  particular,  low-and-high  gain  feedback  laws  are  constructed  that  not  only 
achieve  semi-global  stabilization  in  the  presence  of  input  additive  uncertainties  but  also  have  the 
ability  to  reject  bounded  input  additive  disturbance. 

Despite  the  numerous  results  on  linear  ANCBC  systems,  the  counterparts  of  the  above- 
mentioned  results  for  exponentially  unstable  linear  systems  are  less  understood.  Recently,  we 
made  an  attempt  to  systematically  study  issues  related  to  the  null  controllable  regions  (or 
asymptotically  null  controllability  regions)  and  the  stabilizability  for  exponentially  unstable 
linear  systems  subject  to  actuator  saturation  and  gave  a  rather  clear  understanding  of  these  issues 
[16].  Specifically,  we  gave  a  simple  exact  description  of  the  null  controllable  region  for  a  general 
anti-stable  linear  system  in  terms  of  a  set  of  extremal  trajectories  of  its  time-reversed  system.  For 
a  linear  planar  anti-stable  system  under  a  saturated  linear  stabilizing  feedback  law,  we  established 
that  the  boundary  of  the  domain  of  attraction  is  the  unique  stable  limit  circle  of  its  time-reversed 
system.  Furthermore,  we  constructed  feedback  laws  that  semi-globally  asymptotically  stabilize 
any  system  with  two  anti-stable  modes  on  its  asymptotically  null  controllable  region.  This  is  in 
the  sense  that,  for  any  a  priori  given  set  in  the  interior  of  the  asymptotically  null  controllable 
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region,  there  exists  a  saturated  linear  feedback  law  that  yields  a  closed-loop  system  which  has  an 
asymptotically  stable  equilibrium  whose  domain  of  attraction  includes  the  given  set. 

The  goal  of  this  paper  is  to  design  feedback  laws  that,  not  only  achieve  semi-global  stabilization 
on  the  asymptotically  null  controllable  region,  but  also  has  the  ability  to  reject  bounded 
disturbance  to  an  arbitrary  level  of  accuracy.  Our  attention  will  be  restricted  to  systems  that  have 
two  anti-stable  modes.  Our  problem  formulation  is  motivated  by  its  counterpart  for  ANCBC 
systems  [15]. 

This  paper  is  organized  as  follows.  Section  2  formulates  the  problem  and  summarizes  the  main 
results.  Sections  3  and  4  establish  some  fundamental  properties  of  the  behaviours  of  planar 
systems.  These  properties  lead  to  the  proof  of  the  main  results  in  Sections  5  and  6  .  Section  7  uses 
an  aircraft  model  to  demonstrate  the  results  obtained  in  this  paper.  Section  8  contains  a  brief 
concluding  remark. 

For  a  set  X,  we  use  dX,  X  and  int(X)  to  denote  its  boundary,  closure  and  interior,  respectively. 
For  a  measurable  function,  w:  [0,  oo)  ->  R,  NL  is  its  L^-norm.  For  a  vector  v,  we  use  (u),-  to 
denote  its  ith  co-ordinate.  For  two  bounded  subsets  X%,  X 2  of  R",  their  Hausdorff  distance  is 
defined  as 

d(Xu  X2)  :=  max  {2(XU  X2),  2(X2,  Z,)} 


where 


d(Xu  X2)  =  sup  inf  ||Xi  -  x2|| 

x,  e  Xx  x2  e  X} 


Here  the  vector  norm  used  is  arbitrary. 


2.  PROBLEM  STATEMENT  AND  THE  MAIN  RESULTS 
2.1.  Problem  statement 

Consider  an  open-loop  system  subject  to  both  actuator  saturation  and  disturbance, 

x  =  Ax  +  b  sat(u  +  w)  (1) 

where  x  e  R"  is  the  state,  u  e  R  is  the  control  input,  w  6  R  is  the  disturbance  and  sat(s)  =  sign(s) 
min  {1,  js|}  is  the  standard  saturation  function.  Assume  that  {A,  b )  is  stabilizable.  We  consider  the 
following  set  of  disturbances: 

OT\=  {w:[0,  00)  ->  R,  w  is  measurable  and  llwlL  <  D}, 
where  D  is  a  known  constant. 

In  addressing  the  practical  stabilization  problem,  we  need  to  describe  the  largest  possible 
region  in  the  state  space  that  can  be  stabilized.  For  this  purpose,  we  introduce  the  notions  of  null 
controllability  and  asymptotic  null  controllability. 

Definition  1 

Consider  system  (1)  in  the  absence  of  the  disturbance  w.  A  state  x0  is  said  to  be  null  controllable 
if  there  exist  a  T  6  [0,  00)  and  a  measurable  control  u  such  that  the  state  trajectory  x(f)  satisfies 
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x(0)  =  x0  and  x(T)  =  0.  The  set  of  all  null  controllable  states  is  called  the  null  controllable  region 
of  the  system  and  is  denoted  by  (€. 

Definition  2 

Consider  system  (1)  in  the  absence  of  the  disturbance  w.  A  state  Xq  is  said  to  be  asymptotically 
null  controllable  if  there  exists  a  measurable  control  u  such  that  the  state  trajectory  x(t)  satisfies 
x(0)  =  x0  and  lim,-,*,  x(f)  =  0.  The  set  of  all  asymptotically  null  controllable  states  is  called  the 
asymptotic  null  controllable  region  of  the  system  and  is  denoted  by  % a . 

In  this  paper,  the  matrix  A  (or  the  corresponding  linear  system)  is  said  to  be  anti-stable  if  all  of 
its  eigenvalues  are  in  the  open  right-half-plane  and  semi-stable  if  all  of  its  eigenvalues  are  in  the 
closed  left-half-plane. 


Proposition  1 

Assume  that  (A,b)  is  stabilizable. 

(a)  if  A  is  semi-stable,  then  „  =  R". 

(b)  If  A  is  anti-stable,  then  (€a  =  ^  is  a  bounded  convex  open  set  containing  the  origin. 

(c)  If 


with  A  n  e  R’,,x"'  anti-stable  and  A2  e  R"2*"2  semi-stable,  and  b  is  partitioned  as 

ta 

accordingly,  then  <€a  -  <€ ,  x  R"1  where  ^  is  the  null  controllable  region  of  the  anti-stable 
system  x,  —  A,Xj  +  sat(if). 


Note  that  if  (A,  b)  is  controllable,  then  *Sa  =  c€. 

Proposition  1  follows  from  a  similar  result  on  the  null  controllable  region  in  Reference  [16]  by 
further  partitioning  A2  and  b2  as 


where  A2o  has  all  its  eigenvalues  on  the  imaginary  axis  and  A2~  is  Hurwitz.  Let  the  state  be 
partitioned  accordingly  as  x  =  [x[  x|o  ^I-]T»  with  x20  e  R"20,  x2-  e  R"2'.  Then 


A\ 

0 


is  controllable  and  the  null  controllable  region  corresponding  to  the  state  [xj  xlo]7  is  x  R"20  by 
Reference  [16].  After  [xl  x70]T  is  steered  to  the  origin,  the  control  can  be  removed  and  the  state 
x2~  will  approach  the  origin  asymptotically. 

Our  objective  is  to  design  a  family  of  feedback  laws  such  that  given  any  (arbitrarily  large)  set  xo 
in  the  interior  of  % B  and  any  (arbitrarily  small)  set  containing  the  origin  in  its  interior,  there  is 
a  feedback  law  from  this  family  such  that  any  trajectory  of  the  closed-loop  system  that  starts  from 
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Xo  will  enter  x«,  in  a  finite  time  and  remain  there.  A  complete  treatment  of  this  problem  was 
provided  in  Reference  [15]  for  ANCBC  systems.  For  such  a  system,  a  linear  feedback  can  be 
designed  so  that  the  domain  of  attraction  of  a  small  neighbourhood  of  the  origin  includes  any 
prescribed  bounded  set  and  the  disturbance  is  rejected  to  an  arbitrary  level  of  accuracy.  It  should 
be  noted  that  Reference  [15]  allows  for  multi-input  and  more  general  saturation  functions  but 
has  the  limitation  that  A  has  no  exponentially  unstable  eigenvalues,  i.e.  A  is  semi-stable.  Many 
earlier  papers  on  control  with  saturating  actuators  also  have  this  limitation.  The  main  reason  is 
that  if  A  has  exponentially  unstable  eigenvalues,  the  largest  possible  region  that  can  be  asymp¬ 
totically  stabilized,  i.e.  the  null  controllable  region,  was  unknown. 

To  achieve  our  control  objectives  for  exponentially  unstable  systems,  we  must  know  how  to 
describe  ma.  In  Reference  [16],  we  gave  some  simple  exact  descriptions  of  ma,  and  constructed 
a  family  of  switching  saturated  linear  controllers  for  a  system  with  two  exponentially  unstable 
modes  that  semi-globally  stabilizes  the  system  on  ma.  For  easy  reference,  we  give  a  brief  review  of 
the  results  in  Reference  [16]  in  the  following  subsection. 

2.2.  Background 
Consider  the  system 

x  =  Ax  +  hsat(u),  (2) 

If  A  is  anti-stable,  then  c€a  =  m  is  a  bounded  convex  open  set.  It  was  shown  in  Reference  [16]  that 
is  composed  of  a  set  of  extremal  trajectories  of  the  time  reversed  system  of  (2). 

The  second  main  result  in  Reference  [16]  is  about  the  stability  analysis  of  the  following 
closed-loop  system: 

x  =  Ax  +  bsat(fx),  x  e  R2  (3) 

where  A  e  R2*2  is  anti-stable  and  A  +  bf  is  Hurwitz.  The  time-reversed  system  of  (3)  is 

z  =  —  Az  —  bsat(fz)  (4) 

Denote  the  state  transition  map  of  (3)  by  :(t,  x0)  )->■  x(t)  and  that  of  (4)  by  xp:(t,  z0)  z{t). 

Then  the  domain  of  attraction  of  the  equilibrium  xe  =  0  for  (3)  is  defined  by 

9\=  jx0  e  R2:  lim  (j>(t,  x0)  =  oj 

Proposition  2 

9  is  convex  and  symmetric.  S9  is  the  unique  limit  cycle  of  systems  (3)  and  (4),  and  has  two 
intersections  with  each  of  the  lines  fx  =  1  and  fx  =  —  1.  Furthermore,  -9  is  the  positive  limit  set 
of  x ji{  ■,  z0)  for  all  z0  ^  0. 

It  was  also  shown  that  9  can  be  made  arbitrarily  close  to  m  by  suitably  choosing/  Since  A  is 
anti-stable  and  (A,  b)  is  controllable,  the  following  Riccati  equation 

A'P  +  PA-  Pbb'P  =  0  (5) 

has  a  unique  positive-definite  solution  P  >  0.  Let  /0  =  —  b'P.  Then  the  origin  is  a  stable 
equilibrium  of  the  system 

x  —  Ax  +  b  sat  (k  f0x),  x  e  R2  (6) 

for  all  k  >  0.5.  Let  9(k)  be  the  domain  of  attraction  of  the  equilibrium  xe  =  0  for  (6). 
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Proposition  3 

Hence,  the  domain  of  attraction  can  be  made  to  include  any  compact  subset  of  <<?  by  simply 
increasing  the  feedback  gain.  We  say  that  the  system  is  semi-globally  stabilized  (on  its  null 
controllable  region)  by  the  family  of  feedbacks  u  =  sat (kf0x),  k  >  0.5.  This  result  was  then 
extended  to  construct  a  family  of  switching  saturated  linear  feedback  laws  that  semi-globally 
stabilizes  a  higher-order  system  with  two  anti-stable  modes. 

2.3.  Main  results  of  this  paper 

Given  any  (arbitrarily  small)  set  that  contains  the  origin  in  its  interior,  we  will  show  that  its 
domain  of  attraction  can  be  made  to  include  any  compact  subset  of  in  the  presence  of 
disturbances  bounded  by  an  (arbitrarily  large)  given  number.  More  specifically,  we  will  establish 
the  following  result  on  semi-global  practical  stabilization  on  the  asymptotically  null  controllable 
region  for  system  (1). 

Theorem  1 

Consider  system  (1)  with  A  having  two  exponentially  unstable  eigenvalues.  Given  any  set 
Xo  <=  int(^a)>  any  set  x®  such  that  0  e  int(xoo),  and  any  positive  number  D,  there  is  a  feedback  law 
u  =  F(x)  such  that  any  trajectory  of  the  closed-loop  system  enters  and  remains  in  the  set  in 
a  finite  time  as  long  as  it  starts  from  the  set  Xo- 

To  prove  Theorem  1,  we  need  to  establish  some  properties  of  planar  linear  systems,  both  in  the 
absence  and  in  the  presence  of  actuator  saturation. 


3.  PROPERTIES  OF  THE  TRAJECTORIES  OF  SECOND-ORDER  LINEAR  SYSTEMS 


We  first  consider  the  second-order  anti-stable  system 


x  —  Ax  = 


0 

1 


-a  i 
a2 


x. 


aua2  >  0 


(7) 


We  will  examine  its  trajectories  with  respect  to  a  horizontal  line  kfx  =  1  where/ =  [0  I],  k  >  0. 
On  this  line,  x2  =  l/k  and  if  xx  >  -  a2/k,  then  x2  >  0,  i.e.  the  vector  x  points  upward;  if 
x,  <  —  a2/k,  then  x2  <  0,  i.e.  the  vector  x.  points  downward.  Above  the  line,  xx  <  0,  hence  the 
trajectories  all  go  leftward.  Denote. 


r-i  if  A  has  real  eigenvalues  ^  X2  >  0 

|  oo  if  A  has  a  pair  of  complex  eigenvalues 


Then  we  have 


Lemma  1 

Let  Xu  ^  —  a2/k  and 
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be  a  point  on  the  line  kfx  =  1.  The  trajectory  x(t)  =  eA,p,t  5*  0  will  return  to  this  line  if  and  only  if 
xu  <  am.  Let  T  be  the  first  time  when  it  returns  and 


n'-[yu~ 

P  =  l 

k  _ 


be  the  corresponding  intersection,  i.e.  p'  =  eATp.  This  defines  two  functions:  Xu-^hi  and 
x„-T.  Then  for  all  xn  e  (—a2/k,  a,„), 


dyn 

dxn 


<-l, 


2-  dT 


d  2y 


11 


dxii 


<0, 


dxn 


>0 


Proof.  See  Appendix  A. 


(8) 

□ 


It  may  be  easier  to  interpret  Lemma  1  by  writing  (8)  as 

dx 1 1  dx 1 1 

An  illustration  of  Lemma  1  is  given  in  Figure  1,  where  pu  p2,  Pi  are  three  points  on  kfx  =  1, 

»-[*].  X'ns[-i4  i- 1,2.3, 

and  p\,  p'2  and  p'3  are  the  first  intersections  of  the  trajectories  that  start  from  pu  p2  and  p3.  Then 


IIP 3  -  Pill  >  II Pi  ~  Pi 


IIP3-P2II  IIP2-P1II 


4  >  1 


(9) 


It  follows  that 


Hence 


II Pi  ~  Pill  ^  j|P2  Pill  1  +  jjp-3  —pill  __ 

Ilpi-Pill  IIP3-P2II  1+|^ 

iiPi  -  Pill  jigi  -  Pill  +  iipi  -  pill  jigi  -  pin  1  +  iipi  -  pill 

Ilp3  —  Pill  IIP3-P2II  +  IIP2-P1II  IIP3-P2«TT1^S  IIP3-P2II 


(10) 


Also  from  (9) 


Hence 


HP's  ~  Pill  „  IIP3-P2II  ,  l+fe^|.  , 
iipi  -  pin  11P2-P1II 


jigi  -  pi  11  iipi  -  piii  +  iipi  -  pi  11  iipi  -  pi  11 i  +  jfgjj  iipi  -  Pi  11 
IIP3-P1II  IIPs  -P2II  +  IIP2-P1II  IIP2  “Pill  1  +j|£^t!l  IIP2-P1II 

Combining  (10)  and  (11),  we  obtain 

Iipi  -  Pi  II  ^  Ilpi-Pill  ^  Ilpi-Pil 


IIP3  —  P2 II  llP3  Pi  II  IIP2  Pi 


>  1 


(11) 


(12) 
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Figure  1.  Illustration  of  Lemma  1. 


We  next  consider  a  second-order  stable  linear  system, 

x  =  /lx  =  ^  -fl1]*’  anfl2>0  (13) 

We  will  study  the  trajectories  of  (13)  with  respect  to  two  horizontal  lines  kfx  =  1  and  kfx  =  -  1 
where/  =  [0  1],  fc  >  0.  On  the  line  kfx  =  -  1,  if  x,  <  -  a2/k,  the  vector  x  points  downward;  if 
xi  >  —  a2/K  the  vector  x  points  upward. 

Let 


__  Oi' 

k 


be  a  point  on  kfx  =  -  1.  There  is  a  point  p’0  on  kfx  =  1  and  Td  >  0  such  that  eAT‘p'0  =  p0, 
\kfeAtp'0\  <  1,  Vte  [0,  Tf\  (see  Figure  2).  Denote  the  first  coordinate  of  p'0  as  xm,  i.e. 


be  a  point  on  kfx  =  1,  then  there  is  a  unique 
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Figure  2.  Illustration  of  Lemma  2. 


on  kfx  =  —  1,  where  yu  e(—  oo,  —  a2/k]  and  T  e(0,  Td]  such  that 

p  =  zATp',  \kfoA‘p'\  <  1,  Vf  6  [0,  T] 
This  defines  two  functions  xu^yn,  and  xu  ->•  T. 


Lemma  2 

For  all  Xu  e(—  oo,  xm),  we  have  xn  <yn  and 


dyn 

dxn 


>  1, 


d2yn 

dxji 


>0, 


dr 

dxn 


>0 


Proof.  See  Appendix  B. 


(14) 


□ 


This  lemma  is  illustrated  with  Figure  2,  where  p\,  p'2,  p[\  are  three  points  on  kfx  =  1  and  pu  p2, 
p3  are  the  three  first  intersections  of  kfx  -  —  l  with  the  three  trajectories  starting  from  p\ ,  p'2,  p'3 , 
respectively.  Then 

jj£i  -P2II  IIPi  -P3II  IIP2-P3II  j 

\\p'i-P2\\  IIP) -Pall  IIP2-P3II 


4.  PROPERTIES  OF  THE  DOMAIN  OF  ATTRACTION 
Consider  the  closed-loop  system 

x  =  Ax  +  b  sat  (kfx),  x  e  R2  (15) 
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Figure  3.  Illustration  for  the  proof  of  Proposition  4. 


where 


au  & 2 ,  b2  >  0,  bx  ^  0,  and /=  [0  1].  If  k  >  a2/b2 ,  then  A  4-  kbf  is  Hurwitz  and  the  origin  is  the 
unique  equilibrium  point  of  (15)  and  it  is  stable.  Denote  the  domain  of  attraction  of  the  origin  as 
S p{k\  then  by  Proposition  2,  d£f(k)  is  the  unique  limit  cycle  of  (15).  We  will  further  show  that  the 
domain  of  attraction  Sf(k)  increases  as  k  is  increased. 

Consider  k0  >  a2/b2 .  Denote  the  increment  of  k  as  5k.  Proposition  2  says  that  d£?(k0)  is 
symmetric  with  respect  to  the  origin  and  has  two  intersections  with  each  of  the  lines  k0fx  =  1  and 
k0fx  =  —  1.  In  Figure  3,  the  closed  curve  is  d3P{k0)  and  pu  p2 ,  p3  (  =  —  p^\  p4(=  —  p2)  are  the 
four  intersections.  Since  at  p2,  the  trajectory  goes  downward,  i.e.  x2  <  0,  so 
(Pi)i  <  ip 2  -  k0b2)/k0  <  0.  From  Lemma  2,  we  have  (p^  <  (p2)1  <  0.  Hence  both  pl  and  p2  are 
on  the  left  half  plane.  Define 


A(*o)=  ~^rlk  +  r~ko 
b2  b2 

Then  A(fc0)  >  0  due  to  the  fact  that  the  trajectory  goes  downward  at  p2. 

Proposition  4 

Suppose  k0  >  a2/b2.  Then  for  all  5k  e  (0,  A (k0)\  £f(k0)  c  £f(, k0  +  5k). 

Proof.  Since  8k  >  0,  the  two  lines  ( k0  +  Sk)fx  =  ±1  lie  in  between  k0fx=  ±  1.  It  follows  that 
the  vector  field  above  k0fx~  1  and  that  below  k0fx  —  —  1  are  the  same  for 

x  =  Ax  +  bsat(k0fx)  (16) 
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and 


x  =  Ax  +  b  sat  (( k0  +  5k)  fx )  (17) 

So,  if  a  trajectory  of  (17)  starts  at  p4  (or  p2),  it  will  go  along  8£A(k0)  to  p  k  (or  p3). 

Claim 

If  a  trajectory  of  (17)  starts  at  a  point  on  8£A(k0)  between  pi  and  p2  and  intersects  the  line 
k0fx  =  —  1,  then  the  intersection  must  be  inside  £A(k0). 

It  follows  from  the  claim  that  any  trajectory  of  (17)  that  starts  from  8SA(k0)  will  stay  inside  of 
£P(k0)  when  it  returns  to  the  lines  kjx  =  ±  1.  So  it  is  bounded  and  hence  belongs  to  £A(k0  +  5k). 
Note  that  any  trajectory  outside  of  S^(k0  +  <5*)  will  diverge  because  the  system  has  a  unique  limit 
cycle.  Since  the  two  sets  are  convex  and  open,  we  will  have  ^{k0)  c  £A(k0  +  8k). 

It  remains  to  prove  the  claim. 

Since  5A{k0)  is  convex,  L(A  +  bk0f)x  from  p,  to  p2  along  8£A(k0)  is  increasing.  Let  s0  be  the 
intersection  of  8S(k0)  with  the  abscissa.  Then  at  s0,  L(A  +  bk0f)x  =  —  n/2 ;  from  pj  to  s0, 
L(A  +  bk0f)xe(— n,  —n/2)-,  and  from  s0  to  p2,  L(A  +  bkQf)x  e  (—  n/2, 0).  Now  consider 
a  point  x  along  8£A(k0)  between  pt  and  p2, 

(1)  If  x  is  between  pi  and  s0,  then  k0fx  <  sat ((k0  +  8k)fx).  If  L (.4  +  bk0f)x  <  Lb,  then  x  of 
(17)  directs  inward  of  dSA  (k0)  and  if  L  (A  +  bk0  f)x )  >  Lb,  then  x  of  (17)  directs  outward  of 
d£L(k0).  Since  L(A  +  bk0f)x  is  increasing,  the  vector  x  may  direct  outward  of  d£A(k0)  for 
the  whole  segment  or  for  a  lower  part  of  the  segment. 

(2)  If  x  is  between  s0  and  p2,  then  k0fx  ^  sat((/c0  +  Sk) fx).  Since  Lb  e  (  —  rc,  —  n/2),  we  have 

L(A  +  bk0f)x)  ^  L  (Ax  +  b  sat ((k0  +  Sk)fx)) 

i.e.  the  vector  x  of  (17)  directs  inward  of  dif  (k0). 

Let 

'-[*»]■  ',>0 

be  a  point  on  d£A(k0)  between  px  and  s0  such  that  x  of  (17)  at  st  directs  outward  of  d£A(k0). 
Let 

be  the  intersection  of  dSf{k0)  with  x2  =  —  h.  Then  by  (1)  the  trajectory  of  (17)  starting  at  Si  will 
remain  outside  of  d^(k0)  above  the  abscissa.  We  need  to  show  that  when  the  trajectory  reaches 
the  line  x2  —  —  h  at  s'2,  it  must  be  inside  d£f(k0). 

Let 


(see  Figure  3).  Denote  the  region  enclosed  by  SxS2s3S4.Si  as  G0,  where  the  part  SxS2  is  on  dSA(k0) 
and  the  other  parts  are  straight  lines.  Since  this  region  lies  between  k0fx  =  ±  1,  the  vector  field  of 


0 

h 
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(16)  on  this  region  is 

Xi  =  -  (a,  +  M>i)*2  =:/iW 
x2  =  Xj  +  (a2  -  ^062)^2  =:/2(x) 

Applying  Green’s  Theorem  to  system  (16)  on  G0,  we  get 

-\\M+£hix‘  <18) 

Note  that  the  left-hand  side  integral  from  s  x  and  s2  and  that  from  s3  to  sA  are  zero.  Denote  the 
area  of  G0  as  g0,  then  from  (18),  we  have 

jx]i  +  (a2  —  k0b2)hxu  —  \y\i  +  (a2  —  k0b2)hyll  =  —  (a2  —  k0b2)Q0  (19) 

Clearly  Q0  >  -  h(xu  +  yu)  by  the  convexity  of  Sf(k0)  and  the  region  G0. 

On  the  other  hand,  we  consider  a  trajectory  of  (17)  starting  at  s,  but  cross  the  line  x2  =  -  h  at 


Firstly,  we  assume  that  S!  lies  between  (k0  +  5 k)fx  =  ±  1.  Apply  Green’s  Theorem  to  (17)  on 
the  region  enclosed  by  sis'2s3s4si,  where  the  part  sxs'2  is  on  a  trajectory  of  (17).  Denote  the  area  of 
the  region  as  g0  +  SQ.  Similarly, 

ixfi  +  (a0  -  k0b2  -  bkb2)hxn  -  |(yu  +  dyn)2  +  (a2  -  k0b2  —  5*b2)Myn  +  ^11) 

=  —  («2  —  k0b2  —  5kb2)(Qo  +  Sq) 

Subtracting  (19)  from  (20),  we  obtain 

—  [yn  —  (u2  —  k0b2  —  5kb2)K]5yii  =(k0b2—a2)5Q  +  5kb2(Q0  +  hxn  +hy1i)  +  j52i1  +Skb2SQ 

(21) 

Note  that  go  +  hxn  +hyu>  0  and  k0b2  -a2>  0. 

From  the  definition  of  A(/c0),  we  have 

(p2)i  —  (a2  ~  k0b2  —  5kb2)—  <  0 

for  all  8k  e  [0,  A(k0)).  Since  yu  <  (p2)u  h  <  1  /k0  and  -  ( a2  -  k0b2  -  Skb2)  >  0,  it  follows  that 

y  1 1  -  (a2  -  k0b2  -  dkb2)h  <0,  V  5k  g  [0,  A(/c0)) 

Now,  suppose  that  5k  g  [0,  A(/c0))-  If  <5vi  1  <  0,  then  s'2  is  outside  of  d.c/J (/v0)  and  we  must  have 
8q  >  0.  In  this  case  the  left-hand  side  of  (21)  is  negative  and  the  right-hand  side  is  positive. 
A  contradiction.  This  shows  that  8yl !  must  be  positive  and  s'2  must  be  inside  dSf{k0).  By  (2),  the 
vector  x  of  system  (17)  directs  inward  of  8^(k0)  from  s2  to  p2,  we  know  that  when  the  trajectory 
reaches  k0fx  =  -  1,  it  must  be  to  the  right  of  p2,  i.e.  still  inside  8^{k0). 

Now  suppose  si  lies  between  (k0  +  8k)fx  =  1  and  k0fx  =  1.  Then  by  applying  Green’s  The¬ 
orem,  we  get  exactly  the  same  equation  as  (21),  although  we  need  to  partition  the  region  enclosed 
by  sis^s^!  into  3  parts.  And  similar  argument  applies.  Thus  we  conclude  that  for  all 
8k  g  [0,  A(k0  )),  y(k0)  c  ^(k0  +  8k).  □ 
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Proposition  5 
Consider 

x  =  Ax  +  b  sat(/x),  x  e  R2  (22) 

where  A  e  R2*2,  b  e  R2x  1  are  constant  matrices,  A  is  anti-stable  and/e  R1  * 2  is  a  variable.  Denote 
the  domain  of  attraction  of  the  origin  for  (22)  as  9’(f).  Then,  at  any/such  that  A  +  bf  is  Hurwitz 
and  has  distinct  eigenvalues,  SA{f)  is  continuous. 


Proof.  We  only  need  to  show  that  dS^(f)  is  continuous.  Recall  from  Proposition  2  that  dSA(f) 
is  a  closed  trajectory  and  has  four  intersections  with  fx  =  ±  1.  Since  the  vector 
x  =  Ax  +  b  sat  (fx)  is  continuous  in/ at  each  x,  it  suffices  to  show  that  one  of  the  intersections  is 
continuous  in  f  Actually,  we  can  show  that  the  intersections  are  also  differentiable  in  /  For 
simplicity  and  for  direct  use  of  Lemmas  1  and  2,  we  apply  a  state-space  transformation, 
x  =  V(f)x,  to  system  (22),  such  that 


V(f)AV~\f) 


fV~l(f)  =  [0  1]=:/  (23) 


Such  a  transformation  always  exists.  To  see  this,  assume  that  A  is  already  in  this  form.  Since  A  is 
anti-stable  and  A  +  bf  is  stable,  (/,  A)  must  be  observable.  So 


n/)  = 


~fA  -  aj 

.  /  . 


in  non-singular  and  it  can  be  verified  that  this  V(f)  is  the  desired  transformation  matrix. 
Moreover,  V(f),  V~1{f),  bff)  are  all  analytic  in  /  Now  consider  the  transformed  system 


x  =  Ax  +  B(f)  sat  (fx) 


(24) 


Note  that  A  and / are  both  independent  of f  Under  the  state  transformation,  SA{f)  is  transformed 
into  S?(f)  =  { V(f)x:  x  e  the  domain  of  attraction  for  (24)  and  d£?(f)  is  its  unique  limit 

cycle.  Let 


Pi  = 


be  a  point  on  fx  =  1  such  that  a  trajectory  starting  at  pj  will  go  above  the  line  and  return  to  the 
line  (for  the  first  time)  at 


Let  7)  be  the  time  for  the  trajectory  to  go  from  to  p\,  then 

eAT-(pl  +  A-'$(f))  =  (p'i  +  A-1Hf)) 


or  equivalently. 


T+FW 

1 


rin  ±  <£/(/»■-] 
_  l+W'WJT 

1 
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where  (•),-,  i  =  1,2,  denotes  the  ith  coordinate  of  a  vector.  It  can  be  verified  from  the  stability  of 
A  +  S(f)f  that  1  +  {A~  1S(f))2  >  0.  So  Lemma  1  applies  here  with  a  changing  of  variables.  We 
can  write  yn  =  ylt  (/  £n).  By  Lemma  l,yn  is  continuously  differentiable  in  xu.  It  is  easy  to  see 
that  _pi i  is  also  continuously  differentiable  in/ 

Suppose  that  the  trajectory  continuous  from  p\  and  intersects  the  line/x  =  —  1  at  a  non-zero 
angle.  Let 


be  the  first  intersection  of  the  trajectory  with  fx  —  —  1.  Note  that  between  fx  =  1  and  fx  =  —  1, 
the  vector  field  of  (24)  is 


x  —  {A  + 


-a1+b1(f)  1. 
a2  +  b2(f)_ 


and  that  A+8(f)f  is  Hurwitz,  so  Lemma  2  applies  and  we  know  that  zn  is  continuously 
differentiable  in  j/j  To  see  that  z, ,  is  also  continuously  differentiable  in /  recall  we  have  assumed 
that  A  +  bf  has  distinct  eigenvalues,  so  the  eigenvalues  are  analytic  in /  From  (48)  in  the  proof  of 
Lemma  2,  we  see  that  T  is  continuously  differentiable  in  Xly  X2  and  hence  in/for  T  <  Td.  Thus 
zu  is  also  continuously  differentiable  in /  (Here  zn  corresponds  to  yu  in  (B2)  and  yu  to  xn  in 
(Bl).)  In  summary,  we  can  write 


Zu  —  zu(/,  ^ll) 

where  zn  is  continuously  differentiable  in  / and  xu.  Now  suppose 


is  a  point  in  the  limit  cycle  d£?{f),  then  we  must  have  zn  =  —  xn,  i.e.. 


zn(/>*ii)  +  *n  =0 


(25) 


due  to  the  symmetry  of  d£?(f).  We  write  g(f,  xtl)  =  zlx(/  xu)  +  xn  =  0. 

By  the  uniqueness  of  the  limit  cycle,  xn  is  uniquely  determined  by  /  By  Lemmas  1  and  2,  we 
know  dzu/dxu  ={dz\Jdyll)dyxJdxll  <  —  1,  so  dg/dxix  #0  and  by  the  implicit  function 
theorem,  xn  is  differentiable  in/  Recall  that 

is  a  point  in  the  vector  field  of  (24).  The  corresponding  intersection  in  the  original  system  (22)  is 


Clearly,  it  is  also  differentiable  in/ 
Combining  Propositions  4  and  5,  we  have 


□ 
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Corollary  1 

Consider  system  (15)  with  A,  b  and/in  the  specified  form.  Given  kt  and  k2,  k2>kl>  a2/b2. 
Suppose  that  A  +  kbf  has  distinct  eigenvalues  for  all  k  e  [/q,  k2].  Then  £A(k)  a  y(k  +  8k)  for  all 
k  e  [fcj,  k2~],  8k  e  [0, k2  —  fc]. 

Proof.  By  proposition  5,  dSA(k)  is  continuous  in  k  for  all  k  e  [k2,  fc2].  So  (p2)i  and  hence  the 
function  A (k)  are  also  continuous  in  k.  If  follows  that  min{A(/c):  ke  [fc1(  /c2]}  >  0.  By  applying 
Proposition  4,  we  have  the  corollary.  □ 

It  can  be  seen  that  there  exists  a  k0  >  0  such  that  A  +  kbfhas  distinct  eigenvalues  for  all  k  >  k0. 
Thus  by  Corollary  1,  £P(k)  will  be  continuous  and  monotonically  increasing  for  all  k  >  k0. 


5.  PROOF  OF  THEOREM  1:  THE  SECOND-ORDER  CASE 

We  will  prove  the  theorem  by  explicit  construction  of  a  family  of  feedback  laws  that  solve  the 
problem.  To  this  end,  let  us  first  establish  some  preliminary  results  for  a  general  system  (1),  not 
necessarily  second  order  or  anti-stable.  Let  P(e)  be  the  positive  definite  solution  of  the  Riccati 
equation. 

A'P  +  PA  —  Pbb'P  +  £/  =  0  (26) 

It  is  known  that  P(e)  is  continuous  for  e  5*  0.  Let /(e)  =  -  b'P(e).  With  u  =  kf(e)x,  we  have  the 
closed-loop  system 

x  =  Ax  +  b  sat  (k f(e)x  +  w)  (27) 

Clearly,  A  +  kbf(e)  is  Hurwitz  for  all  k  >  0.5.  For  x(0)  =  x0,  w  e  iT,  denote  the  state  trajectory  of 
(27)  as  x0,  w). 

Lemma  3 

Consider  system  (27).  Let  e  >  0  be  given.  Let  cm  =  a max {P{c))D2 j v.{2k  —  1),  c0  =  4 /b'P(e)b. 
Suppose  k  is  sufficiently  large  such  that  cx  <  c0.  Denote 

SAp(e):=  {x:  x'P(e)x  <  c0} 

k)  :=  {x:  x’P(s)x  <  c^} 

Then,  SAp(e)  and  £AJe,  k)  are  invariant  sets,  and,  for  any  weir,  x0  e  £Ap(e),  ^(t,  x0,w)  will  enter 
y„(£,  k)  in  a  finite  time  and  remain  there. 

Proof.  Let  V{x)  =  x'P(e)x.  It  suffices  to  show  that  for  all  x  e  yp(e)\S%,(s,  k)  and  for  all  |w|  <  D, 
V  <  0.  In  the  following,  we  simply  write  P(e)  as  P  and  f(e)  as /  since  in  this  lemma,  e  is  fixed.  Note 
that 

V  =  x'(A'P  +  PA)x  +  Ix'Pb  sat  (kfx  +  w) 

We  will  consider  the  case  where  x'Pb  ^  0.  The  case  where  x'Pb  ^  0  is  similar. 
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If  kfx  +  w  $  —  1,  then 


V  =  x'{A'P  +  PA)x  -  Ix'Pb 
=  x'Pbb'Px  -  Ix'Pb  -  ex'x 


=  x'Pb(x'Pb  -  2)  -  ex'x 

Since  x’Px  ^  c0  =  4/b'Pb,  we  have  b'Px  ^  \\b'Pm\\  ||P1/2x|!  <  2,  and  hence  V  <  0. 

If  kfx  +  w  >  —  1,  then  sat  (kfx  +  vv)  ^  kfx  +  w,  and, 

V  <  x'iA'P  +  PA)x  +  2x'Pb(kfx  +  w) 

=  —  (2k  —  l) x’Pbb'Px  -  ex'x  +  Ix'Pbw 

-  w  \2  w2 

2k -Ix'Pb - .  - . -=  +  - 7  -  ex'x 

^2k^\J  2k  - 1 

Since  x'Px  >cx  =  crma%{P)D2/e(2k  -  1),  we  have  x'x  >  D2/e{2k  -  1).  It  follows  that  F  <  0.  □ 

It  is  clear  from  Lemma  3  that  as  k  goes  to  infinity,  (e,  k)  converges  to  the  origin.  In  particular, 
there  exists  a  k  such  that  (e,  k)  c  y.r. 

For  any  ANCBC  system,  as  e  -*•  0,  P(e)  ->  0,  and  c0  -*•  oo.  Thus  £fp(e)  can  be  made  arbitrarily 
large;  and  with  a  fixed  e,  we  can  increase  k  to  make  c„  arbitrarily  small.  So  the  proof  of 
Theorem  1  would  have  been  completed  here.  However,  for  exponentially  unstable  systems,  £Pp(e) 
is  a  quite  small  subset  of  <ga  as  e  -*  0  [16]  and  hence  considerable  work  needs  to  be  carried  out 
before  completing  the  proof. 

Define  the  domain  of  attraction  of  the  origin  in  the  absence  of  disturbance  as 

SP(e,  k)  :=  <x0 :  lim  i ft{t,  xo,0)  =  0 

t  -*  OO 

and  in  the  presence  of  disturbance,  define  the  domain  of  attraction  of  the  set  (e,  k)  as 
SPD(e,  k):=  <x0:  lim  d(ij/(t,  x0,  w),  SPm(e,  k))  =  0,Vwe#' 

t  -*  00 

where  d(ij/(t,  x0,  w),  SPx{e,  k))  is  the  distance  between  the  point  <p(t,  x0,  w)  and  the  set  £Px{e,  k).  Our 
objective  is  to  choose  e  and  k  such  that  Xo  c  £PD(e,k)  and  S^le, k)  c 
Clearly  yp(e)  <=  £PD{e,  k)  <=  SP(e,  k).  By  using  the  Lyapunov  function  V{x)  =  x'P{e)x,  we  can 
only  determine  a  subset  £Pp{e)  of  £Pd(e,  k).  As  e  decreases,  P(e)  decreases.  It  was  shown  in  Reference 
[17]  that  if  E\  <  e2,  then  £Pp{e2)  <=  SPp{e j).  So  by  decreasing  e,  we  can  enlarge  6Pp(e).  However,  since 
lim^o-S^O)  can  be  much  smaller  than  #a,  we  are  unable  to  prove  that  SPD(e,k)  is  close  to  by 
simply  enlarging  £Pp(e)  as  was  done  in  Reference  [15].  For  this  reason,  we  will  resort  to  the 
detailed  investigation  on  the  vector  field  of  (27)  in  the  presence  of  the  disturbance. 

We  now  continue  with  the  proof  of  the  theorem  and  focus  on  the  second  order  systems.  Also 
assume  that  A  is  anti-stable.  In  this  case  =  c€. 

We  will  prove  the  theorem  by  showing  that,  given  any  Xo  c  int(^),  any  (arbitrarily  small) 
such  that  0  e  int^*),  and  any  D  >  0,  there  exist  an  e  >  0  and  a  fc  >  0.5  such  that  Xo  c  «^d(£>  k) 
and  £Px(e,k)  c^. 
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Proposition  3  applies  to  the  case  where  e  =  0.  It  means  that  lim*^  d(£A( 0,  fc),  =  0.  But  when 
e  =  0,  it  is  impossible  to  achieve  disturbance  rejection  by  increasing  the  value  of  k  even  if  there  is 
no  saturation.  We  can  first  let  e  =  0,  choose  k0  sufficiently  large  so  that  A  +  k0bf(s)  has  distinct 
eigenvalues  and  xo  c  int(5^(0,fco))-  Then  by  the  continuity  of  the  domain  of  attraction  stated  in 
Proposition  5  and  the  continuity  of  the  solution  of  the  Ricatti  equation,  we  can  fix  this  k0  and 
choose  a  sufficiently  small  so  that  Xo  c  int(«S^(fi,  k0)).  By  Corollary  1,  we  know  that  ^(e,  fc)  is 
non-decreasing,  so  Xo  c  int(5^(fi,  k))  for  all  k  >  fc0.  What  remains  to  be  shown  is  that  for  any 
given  positive  number  D  and  a  fixed  £,  we  can  choose  k  sufficiently  large  so  that 
d(£fD(e,  k ),  Sf(e,  k))  is  arbitrarily  small.  Then  we  will  have  Xo  <=  k)  for  some  k. 

Now,  let  us  fix  an  e  such  that  Xo  c  int(^(e,fc)),  Vfc  >  k0.  Since  e  is  fixed,  we  can  assume  that 
a  state  transformation  x  =  Vx  like  (23)  is  performed  so  that 

f=-b'P{t ^)F"1  =  [0  1]  (28) 


A  =  VAV~l  = 

0 

-fll" 

1 - 

jT  . 
! 

i _ 

II 

II 

co 

_1 

fl2j 

l~b2j 

d-ud2yb\yb2  >  0 


(29) 


where  alya2>  0  is  from  the  anti-stability  of  A  and  bu  b2>0  follows  from  the  fact  that  an  LQ 
controller  has  infinite  gain  margin  and  £  ^  0.  (bx  =  0  iff  e  =  0).  Under  this  state  transformation, 
the  sets  ^p(e\  6^D(eyk),  ^(e.k),  <€y  Xo  and  loo  are  transformed,  respectively,  into  SPp{e\ 

£?D{eyk),  y(e,k),  ^(e,  fc),  <£,  xo  and  x<x>,  all  defined  in  an  obvious  way.  For  example, 
<£  =  {Vx:x  e#}.  Let  P(e)  =  (V~1),P(e)V~K  Since  e  is  now  fixed,  we  denote  P(e),  5^(s),  «9x>(£,k), 
Sf  (fi,  fc),  and  <9^(£,fc),  as  P ,  ¥p,  &D{k\  £?(k)  and  ^(fc),  respectively. 

Now  we  consider 


x  ~  Ax  - F  Ss&t{kf x  4-  w)  (30) 

This  standard  form  fits  very  well  into  Corollary  1,  so  we  can  be  sure  that  £f(k)  increases  as  k  is 
increased.  It  follows  that 


^(k0)  c  S?(k),  Vk  >  k0 

To  satisfy  the  design  requirement,  it  is  necessary  that  no  point  in  Xo\loo  can  be  made  stationary 
with  any  |w|  <  D.  Let  us  first  exclude  this  possibility  by  appropriate  choice  of  k. 

For  a  constant  w,  there  are  three  candidate  equilibrium  points,  x*  =  —  A~xSy  x“  —  A"1  £  and 
x,”  =  —  (A  +  k£f)~1£w,  corresponding  to  sat(fc/x  +  w)  =  1,  sat(k/x  +  w)  =  —  1  and 
sat (fc/x  +  w)  =  kfx  +  w,  respectively.  For  each  of  them  to  be  an  actual  equilibrium  point,  we 
must  have 


respectively. 
Here  we  have 


kfxt  4*  w  ^  1,  k/xc  +  w  <  —  1  or  \kfx”  +  w|  <  1 


Xe" 


Xe 


1  d2b i  *4  dxb2 
+  £qk  ^ 


w 


If^Thas  no  complex  eigenvalues,  then  x* ,  xe~  e3^[16],  soxe+,x~  foranyf0  c  int(^).  But  if 
A  has  a  pair  of  complex  eigenvalues,  x*,  xf  e  int(^)  and  will  be  in  xo  if  Xo  is  close  enough  to 
So,  it  is  desirable  that  xe+  and  xe”  cannot  be  made  stationary  by  any  |w|  <  D.  This  requires 


k/xe+  4-  w  <  1,  k/xe  4-  w  >  —  1,  V|w|  ^  D 
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which  is  equivalent  to  k(bi/ai)  +  w  >  —  1,  V|w|  ^  D.  If  D  ^  1,  this  is  satisfied  for  all  k,  if  D  >  1, 
we  need  to  choose  k  such  that 


k>^(D-  1) 

hi 


Note  that  this  will  be  impossible  if  bx  =  0,  which  corresponds  to  the  case  where  e  =  0.  This  is  one 
reason  that  e  should  be  non-zero. 

Finally,  as  k  ->  oo,  x"  -*  0  for  all  |w|  ^D.Sok  can  be  chosen  large  enough  such  that  xf <txo\x«,- 
In  summary,  from  the  above  analysis,  we  will  restrict  ourselves  to  k  such  that 


D  [a2bi  +  a1b2 

i  z.  r  u  ^ 

<i\  +  I>i k  |_  —  b i 


(31) 


To  study  the  vector  field  of  (30),  we  rewrite  it  as 

xx  =  —  atx2  —  bisat{kfx  +  w) 
x2  =  xt  +  a2x 2  -  b2sat(kfx  +  w) 

The  vector  field  is  much  complicated  by  the  presence  of  the  disturbance.  However,  it  still  exhibits 
some  properties  which  we  will  make  use  in  our  construction  of  the  desired  controller: 

•  Above  the  line  k fx  =  73  +  1,  kfx  +  w  ^  1  for  all  |w|  <  D,  so  sat  (kfx  -Mv)  =  1,  i.e.  the 
vector  x  is  independent  of  w  and  is  affine  in  x.  Similarly,  below  kfx  =  -{D  +  1), 
sat(/c/x  +  w)  =  —  1. 

•  In  the  ellipsoid  Z?p,  we  have  shown  that  all  the  trajectories  will  converge  to  S^(k),  which  can 
be  made  arbitrarily  small  by  increasing  the  value  of  k. 

Suppose  that  k  is  sufficiently  large  such  that  the  boundary  of  intersects  with  the 
lines  kf. x=  ±(D  +  1).  Denote  the  region  between  kfx  =  (X>  +  1)  and  kfx  =  —  (£>  +  1),  and  to 
the  left  of  S?p  as  Q(k),  see  the  shaded  region  in  Figure  4.  Let 

xm(k)  =  —  max  {xj :  x  €  Q(k)} 

If  k  is  sufficiently  large,  then  Q(k)  lies  entirely  in  the  left-half-plane,  so  xm(k)  >  0.  Choose  K  such 
that 


Xju(^)  4-  &2 


D+  1 
K 


<0, 


-  xJjK)  +  a2(D  ±  l)/K  b2 

-ai(D  +  l)/K  bi 


(32) 


(Note  that  xm(fc)  increases  as  k  is  increased.)  Then  the  vector  field  in  Q(k)  has  the  following 
property: 


Lemma  4 

Suppose  k>  K.  Then  for  all  x  e  Q(k),  |w|  s£  D, 

tan- 1  ^  -  t i<L  (if  [  +  b]j^Lt<  tan" 1  (33) 

This  implies  that  for  any  straight  line  E  with  slope  b2/b  , ,  if  x  e  E n  Q(k),  then  the  vector  x  points  to 
the  right  of  E  for  all  |vv[  <  D. 
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Figure  4.  The  vector  field  of  system  (30). 


oof.  Between  the  lines  kfx  =  D  +  1  and  kfx  =  —(D  +  1),  sat(/c fx 
,  1]  and  hence, 

^{[»,75J+A[3ae[-U]} 

1  f—\ 

\bj 


it  (kfx  +  w)  takes  values 


in 


(34) 


x  e  Q(k),  if 


fb  \  fb 

tan-1  (  7-^)  —  71  <  LAx  <  tan-1  f 
\bj  V>i 


tan" 


k)  is 


+  A£)  <  tan 

increasing,  we  see  from  (32)  that  for  all  k 
D  +  1 

-  xjk)  +  a2  —j— 


'(r),  VAe  [  —  1,  1]  (35) 

\bij 


>K, 

-Xm(k)  +  a2^fl 
lc  ’  -  - 


b2 


V  T  ^2  IT  ^2 

fll5±i  V 


that 

'*2 

,b 


l 

i{k\  we  have  xx  ^ 

4 


.(*)' 


-  x,„(k) 

JP+  1 


\  r  —  CLi^T^  *1  71  -l(b2\ 

J  +  ”2<tan  W 

Xm(fe),  |x2l  <  (D  +  l)//c.  So 


<  Z_Ax  <0 


/a_\ 
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Hence  by  (35), 

for  all  x  e  Q{k)  and  |w|  <  D.  It  can  be  further  verified  that 

min  {LAx  +  l$:xe  Q(k),  k e  [-  1, 1]}  >  l(a  +  bj>  tan“ 1  -  n 

so  (33)  follows.  ^ 

This  lemma  means  that  any  trajectory  of  (30)  starting  from  inside  of  Q(k )  and  to  the  right  of 
E  will  remain  to  the  right  of  E  before  it  leaves  Q(k). 

Based  on  Lemma  4,  we  can  construct  an  invariant  set  .f  (k)  c:  £f(k)  and  show  that  it  is  also 
a  subset  of  /D(fc).  Moreover,  it  can  be  made  arbitrarily  close  to  £?{k). 


Lemma  5 

(a)  if  k  >  K  satisfies  (31)  and 

(  a2(D  +  l)')  bi{D  4-  1) 

(‘2  — ^7 >  ~i*r 


(36) 


then  there  exist  unique  pl5  p2e  &{k)  on  the  line  kfx  —  D  +  1  such  that  the  trajectory  of  (30) 
starting  at  px  goes  upward,  returns  to  the  line  at  p2  and  the  line  from  p2  to  —pt  has  slope  bjb i 
(see  Figure  5,  where  the  outer  closed  curve  is  dS?(k)). 

(b)  Denote  the  region  enclosed  by  the  trajectories  from  ±  Pi  to  +  p2,  and  the  straight  lines 
from  ±p2  to  +  Pi  as  £^(k).  (In  Figure  5,  the  region  enclosed  by  the  inner  closed  curve.)  Then 

lim  d(^(k\  £?{k))  =  0 

k  -*  co 

(c)  6^(k)  is  an  invariant  set  and  £?,(k)  c  S?D(k),  i.e.,  it  is  inside  the  domain  of  attraction  of  S?„(k). 

Proof.  Recall  that  8S?(k)  is  a  closed  trajectory  of  (30)  with  w  =  0.  Denote  the  intersections  of 
dS?(k)  with  kfx  =  D  +  1  as  Sj  and  s2  (see  Figure  5).  Let 


then  x2  =  0  at  p0  and  to  the  left  (right)  of  p0,  x2<0(>  0).  Let  p,  be  a  point  on  kfx  =  D  +  1 
between  p0  and  su  then  a  trajectory  starting  at  pi  goes  upward  and  will  return  to  kfx  =  D  +  1  at 
some  p2  between  p0  and  s2.  p2  is  uniquely  determined  by^pt.  We  then  draw  a  straight  line  from 
p2  with  slope  b2/bv  Let  the  intersection  of  the  line  with  k  fx  =  —  (D  +  1)  be  p3.  Clearly,  p2  and  p3 
depends  on  Pi  continuously.  And  the  quantity 


(P3  —  (  —  «l)) 

(Si  -  Pi) 
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Figure  5.  Illustration  for  Lemma  5. 


also  depends  on  px  continuously.  If  px  =  su  then  p2  =  s2.  Note  that  the  trajectories  above  the  line 
kfx  =  D  +  1  are  independent  of  w  and  hence  are  the  same  with  those  with  w  =  0.  Since  s2  and 
—  Si  are  on  a  trajectory  of  (30)  with  w  =  0,  so  by  Lemma  4,  —  $x  must  be  to  the  right  of  the 
straight  line  with  slope  b2/bx  that  passes  s2.  This  shows  —  sx  is  to  the  right  of  p3  (with  px  =  sx) 
and  hence  limPi  _Si  r(px)  =  —  oo.  If  px  =  p0,  then  p2  =  p0  and 

n>,  -  ibSRll)  -  ag+iftn 

p,  =  2  * 

F3  __  a+i 

*  _ 

So 


K/h  =Po)  = 


>  |  k  a2(U+l)  2(0+1)^ 

igiJi  +  o2 . . r  —  kb2 


(Sl)l-(fe2-^^) 


And  by  condition  (36),  r(px  =  p0)  >  L  Since  limPi  -5lr(pi)  =  —  oo,  by  the  continuity  of  r(pn),  there 
exists  a  between  sx  and  p0  such  that  r(px)  =  1,  i.e.  p3  =  —  px  and  hence  the  line  from  p2  to  —px 
has  slope  b2/bx.  This  shows  the  existence  of  (px,  p2)  in  (a).  Suppose  on  the  contrary  that  such  pair 
(pu  p2)  is  not  unique  and  there  exists  (p'x ,  p2)  with  the  same  property,  say,  p\  to  the  left  of  px  and 
p'i  to  the  right  of  p2,  by  Lemma  1,  ||p2  -  p'2||  >  \\px  -  p'J.  But  ||(  -  px)  -  (— Pi)I|  =  ||p2  -  pill 
since  the  line  from  p2  to  —px  and  that  from  p2  to  —  p\  have  the  same  slope.  This  is  a  contradic¬ 
tion. 

(b)  We  see  that  x2  —  0  at  p0)  so  by  applying  Lemma  1  with  a  shifting  of  the  origin, 


IIP2-s2ll  IlPo  —  s2ll  t 
lIPl  -&l\\  llPo-Sill 
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(refer  to  (12)).  As  k  -*■  oo,  s2  +  s,  -*•  0,  and 


Since  sx  and  s2  are  restricted  to  the  null  controllable  region  <£,  there  exist  some  Kl>0,y>0, 
such  that  for  all  fc  >  Ku 


IlPo  —  gall 
IlPo  —  si  II 


^  l  +  y  => 


IIP2  ~  ^2 II 

llPl  "Sill 


>  1  +  y 


(37) 


From  Figure  5,  we  see  that 

||P2  —  S2II  =  llPl  ~  slll  +  (  — S,  —  S2)i  +  (p2  —  (—  Pl))l 
As  k  -*•  00,  2 (£>  +  1  )/k  -+  0,  so  (p2  -  (-  Pi))i  -*  0.  Since  s,  +  s2  -» 0,  we  have 

II p2  s2 1|  -  ||p,  —  Si ||  — >  0 

From  (37),  ||p2  —  s2 1|  —  ||p,  -  s,  ||  >y  Up,  -  s,  II •  So  we  must  have  ||pi  —  sx  ||  -*•  0  and  hence 
IIP2  —  s2 1|  -» 0.  Therefore,  limk->00d(S?I(k),  £?(k))  =  0. 

(c)  First  we  show  that  £?i(k)  is  an  invariant  set.  Note  that  o,c/j (k)  from  p,  to  p2  and  that  from 
— Pi  t0  —  P2  are  trajectories  of  (30)  under  any  |w|  D.  At  any  point  on  the  line  from  p2  to  —  pu 
Lemma  4  says  that  x  directs  to  the  right  side  of  the  line,  i.e.  no  trajectory  can  cross  the  line  from 
p2  to  — pi  leftward,  symmetrically,  no  trajectory  can  cross  the  line  from  — p2  to  p,  rightward. 
These  show  that  no  trajectory  can  cross  dS^(k)  outward,  thus  £^k)  is  an  invariant  set.  Since  ifp  is 
also  an  invariant  set  and  any  trajectory  that  starts  from  inside  of  it  will  converge  to  5^,(/c),  it 
suffices  to  show  that  any  trajectory  that  starts  from  inside  of  S^(k)  will  enter  5^.  We  will  do  this  by 
contradiction. 

Suppose  that  there  exist  an  x0  e  5^(fc)\^  and  a  we#  such  that  ^(t,  x0,  w)  €  S?i(k)\£?p  for  all 
t  >  0,  then  there  must  be  a  point  x*  e  5^(A:)\5^  either 

(1)  lim,.,*  ^(t,  x0,  w)  =  x*;  or 

(2)  there  exists  a  sequence  tu  t2, ... ,  tit ...  such  that  lim,^„  }p(th  x0,  w)  =  x*  and  there  is  an 
s  >  0  such  that  for  any  T  >  0,  there  exists  t  >  T  satisfying  \\\j/(t,  x0,  w)  —  x*||  >  c. 

Item  (1)  implies  that  x*  can  be  made  stationary  by  some  wef.  This  is  impossible  as  we  have 
shown  that  k  has  been  chosen  such  that  all  the  stationary  points  are  inside  5^(/c).  Item  (2)  implies 
that  there  is  a  closed  trajectory  with  length  greater  than  2c  that  passes  through  x*.  There  are  two 
possibilities  here:  the  closed  trajectory  encloses  S?p  or  it  does  not  enclose  We  will  show  that 
none  of  the  cases  is  possible. 

Suppose  that  there  is  a  closed  trajectory  that  encloses  5^.  Let  qu  q2,  q2,  q*.  be  the  four 
intersections  of  the  closed  trajectory  with  kfx  =  ±  (D  +  1)  as  shown  in  Figure  6.  By  Lemma  1 

|lp2  *?2  II  >  llPl  -«lll,  11^4-  —  (  — P2>ll  >  11^3  —  (— Pl)ll 

and  by  Lemma  4, 

\\q3 -(-Pi)ll  >  IIP2  ~«2II>  IIPi  —  II  >  Ik4~(-P2)ll 


So  we  have 


IIP2  —  qi\\  >  llpi  —  qi II  ^  11^4  —  ( —  P2) II  >  11^3  —  (  Pi) II  ^  llp2  ?2 II 
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Figure  6.  Illustration  of  the  proof. 


A  contradiction.  Therefore,  there  exists  no  closed  trajectory  that  encloses  Sfp.  We  next  exclude  the 
other  possibility. 

Clearly,  there  can  be  no  closed  trajectory  that  is  completely  above  /c/x  =  D  +  1  or  below 
kfx  =  —(£>  +  1).  So  if  there  is  a  closed  trajectory,  it  must  intersect  kfx  =  D  +  l  or 
kfx  =  -  (D- f  1)  to  the  left  (or  to  the  right)  of  S?p  at  least  twice,  or  lies  completely  within  g(/c).  We 
assume  it  is  to  the  left  of  <9^.  Since  k  >  K  satisfies  (36),  so  xm(k)  >  0  and  b2  —  a2(D  +  l)/k  >  0. 
Hence  for  all  points  on  the  line  kfx  —  D  -F  1  to  the  left  of  5^,  x2  <  0,  so  no  closed  trajectory  lying 
between  «9^j(/t)  and  will  cross  this  piece  of  straight  line  twice.  On  the  line  kfx  =  —  (D  -F  1)  to 
the  left  of  <9^,  x1  >  0.  Since  no  trajectory  in  Q(k)  will  cross  a  line  that  is  parallel  to  the  line  from  p2 
to  —  pi  leftward,  there  will  be  no  closed  trajectory  crossing  the  line  kfx  —  —  (D  +  1)  to  the  left  of 
<9^  twice.  In  view  of  Lemma  4,  there  exists  no  closed  trajectory  completely  inside  Q(k).  These  show 
that  there  exist  no  closed  trajectory  that  does  not  enclose  either. 

In  conclusion,  for  every  x0  e  9 j(/c),  there  must  be  a  T  <  oo  such  that  i/r(X,  x0,  w)  e  <9^.  And 
since  Sfp  is  in  the  domain  of  attraction  of  «9^(/c),  it  follows  that  x0e^D{k)  and  hence 
S?j(k)  <=  £?D(k).  □ 

The  proof  of  Theorem  1  can  be  completed  by  invoking  Lemmas  3  and  5.  For  clarity,  we 
organize  it  as  follows,  including  a  constructive  method  to  choose  the  parameters  e  and  L 

Proof  of  Theorem  1.  Given  Xo  c  int(^),  x<x>  such  that  0  €  int^oo  and  D  >  0,  we  need  to  choose 
e  and  k  such  that  xo  c  ^d(£>  ty  an(l  <^oofe  k)  cz  x «>• 

Step  1:  Let  s  =  0  and  find  k0  such  that  Xo  02  int(«9^(0,  k0)).  This  is  guaranteed  by  Proposition  3. 
Increase  fc0,  if  necessary,  such  that  A  +  k0b f(e)  has  distinct  eigenvalues. 

Step  2:  Find  e  >  0  such  that  Xo  c  int(«9^(fi,  k0)).  This  is  guaranteed  by  Proposition  5  that 
£P(e}  ko)  is  continuous  in  f(s)  and /(e)  is  continuous  in  e. 
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Step  3:  Fix  e  and  perform  state  transformation  x  =  Vx  such  that  (/  A ,  B)  is  in  the  form  of  (28) 
and  (29).  Also  perform  this  transformation  to  the  sets  zo >  Zoo  to  get  z0>  Zoo-  We  do  not  need  to 
transform  £A(e,  k0 )  to  S?(k0)  but  should  remember  that  %o  <=  int(^(fc0)). 

Step  4:  Find  k>  K  satisfying  (31)  and  (36)  such  that  %o  c  *£/(£)■  Since  Xo  <=  int(5^(fc0)),  we 
have  xo  c  int (S?(k))  for  all  k  >  k0.  So  by  Lemma  5,  Xo  c  (&)  <=  «5^>(fc)  for  some  k  >  0.  It 
follows  that  zo  c  ^(e,fc). 

Step  5:  Increase  k,  if  necessary,  so  that  ^(s,  k)  cz  x This  is  possible  due  to  Lemma  3.  □ 


6.  PROOF  OF  THEOREM  1:  HIGHER-ORDER  SYSTEMS 


As  with  the  stabilization  problem  in  Reference  [16],  where  the  disturbance  is  absent,  the  main 
idea  in  this  section  is  first  to  bring  those  exponentially  unstable  states  to  a  ‘safe  set’  by  using 
partial  state  feedback,  then  to  switch  to  a  full  state  feedback  that  steers  all  the  states  to 
a  neighbourhood  of  the  origin.  The  first  step  control  is  justified  in  the  last  section  and  the  second 
step  control  is  guaranteed  by  the  property  of  the  solution  of  the  Riccati  equation  and  Lemma  3, 
which  allow  the  states  that  are  not  exponentially  unstable  to  grow  freely. 

Without  loss  of  generality,  assume  that  the  matrix  pair  (A,  b)  in  system  (1)  is  in  the  form  of 


A  = 


where  A1eR2x2  is  anti-stable  and  A2eRn  is  semi-stable.  Assume  that  (A,  b)  is  stabilizable. 
Denote  the  null  controllable  region  of  the  subsystem 


x1  =  A iXi  -f  fctsat(M) 


as  Then  the  asymptotically  null  controllable  region  of  (1)  is  =  R".  Given  any 

ji  e(0, 1),  and  y2  >  0,  denote 

«2(y2):=  e  R”:  ||^2||  <  y2}  (38) 

For  any  compact  subset  Xo  of  —  c&\  *  R",  there  exist  y ,  and  y2  such  that  Xo  c  ^i(Ti)  x  n2(y2)- 
For  this  reason,  we  assume,  without  loss  of  generality,  that  Xo  =  1  (}’  1 )  x  Q2(y2). 

For  e  >  0,  let 


?(£)  = 


P&) 

_P'2(e)  P3(e) 

be  the  unique  positive  definite  solution  to  the  ARE 


gR<2  +  n)  x  (2  +  n) 


A'P  -f -PA-  Pbb'P  A  el  =  0  (39) 

Clearly,  as  eJO,  P(e)  decreases.  Hence  \imE^0  P(s)  exists. 

Let  Px  be  the  unique  positive  definite  solution  to  the  ARE 


A\P i  +  PXAX  -  PihVtPt  =  0 


Then  by  the  continuity  property  of  the  solution  of  the  Riccati  equation  [18], 


limP(£)  =  R1 

£  -*■  0  L  u 


r 
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Let  f{e):=  —  b'P(e).  Let  us  first  study  the  following  closed-loop  system 

x  =  Ax  +  b  sat (kf(e)x  +  w)  (40) 

Recall  from  Lemma  3,  the  invariant  set  ^p(s)  is  a  domain  of  attraction  of  the  set  k). 

Lemma  6 
Denote 


ri(£):  !|p!/2(£)  IP'P1/2(£)II 


r2(e):= 


-  mm  +  Viip^ii2  +  nKm  nwi 

\\p3m 


r  i(e) 


Then 

Dt(£):=  {x  e  R2+n:  ||xj ||  sSMe),  ||x2||  <r2(e)}  c  Sfp(e) 

Moreover,  lim£-o  r2(e)  =  °o,  and  r^e)  increases  with  an  upper  bound  as  e  tends  to  zero. 
Proof.  Similar  to  the  proof  of  Lemma  4.4.1  in  Reference  [16]. 


□ 


Proof  of  Theorem  1.  Denote  Xio  =  ^(TiX  then  Xio  c=  int(#i).  Given  e0  >  0,  let 
Xiao  =  {*i  eR2:||x1||  <  r1(e0)}.  By  the  result  of  the  second-order  case,  there  exists  a  controller 
u  =/i*i  such  that  any  trajectory  of 

X!  =  Axxx  +  bi  satC/jX!  4-  w)  (41) 


that  starts  from  within  xio  will  converge  to  %lo0  at  a  finite  time  and  stay  there.  Denote  the 
trajectory  of  (41)  that  starts  at  x10  as  i l/x(t,  x10,  w)  and  define 

Tu:=  max  min  {t  >  0:  <Mt,  x10,  w)  e  Xi*} 

*i<>edXio,we  iT 

(An  upper  bound  on  TM  can  be  obtained  by  estimating  the  largest  possible  length  of  a  trajectory 
xio>  vv),  x10  e  Xio  before  it  enters  xioo  from  Lemma  1  and  (33),  and  the  minimal  ||Xi  ||  outside 
of  xioo-  To  apply  (33),  we  can  construct  a  region  similar  to  Q(k)  by  using  %loo  instead  of  i?p)  Let 

fT* 

y  =  max  ||e^‘||y2  +  \\^T^%2\\dx  (42) 

t  e  [0,  T*]  J  0 

then  by  Lemma  6,  there  exists  an  e  <  e0  such  that  ri(fi)  ^  rfe 0),  r2(e)  ^  y  and 

D^e)  =  {x  €  R2+”:  ||x;1||  ^  r^e),  ||x2||  =*  r2(e)}  c:  yp(e) 

lies  in  the  domain  of  attraction  of  ^(s,  k). 

Choose  k  such  that  k)  c=  x<x>,  and  let  the  combined  controller  be 


u(t)  = 


flXdt), 

fe/(e)x(t), 


X  e  ^p(e) 


(43) 


and  consider  an  initial  state  of  the  closed-loop  system  of  (1)  with  (43),  x0  e  Qi  (y  i)  x  n2(y2).  If 
x0  6  STp(e),  then  x(t)  will  enter  ,7’,„ (e,  k)  c  yx .  If  x0££fp(e),  we  conclude  that  x(t)  will  enter  //J/c)  at 
some  T,  TM  under  the  control  u  =/1x1.  Observe  that  under  this  control,  x,(t)  goes  along 
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a  trajectory  of  (41).  If  there  is  no  switch,  x2(t)  will  hit  the  ball  yA  aj  at  7\  <  TM  and  at  this  instant 
ll^2(^i)ll  <  y  <  r2(e),  so  x(T’i)  e  D^e).  Thus  we  see  that  if  there  is  no  switch,  x(t)  will  be  in  D^e)  at 
T\.  Since  Di(e)  c:  yp(s),  x(t)  must  have  entered  £^p(e)  at  some  earlier  time  T  ^  <  TM.  So  we  have 
the  conclusion.  With  the  switching  control  applied,  once  x(£)  enters  the  invariant  set  S^p(e),  it  will 
converge  to  ^(e,  k)  and  remain  there.  □ 


7.  EXAMPLE 


In  this  section,  we  will  use  an  aircraft  model  to  demonstrate  the  results  obtained  in  this  paper. 
Consider  the  longitudinal  dynamics  of  the  TRANS3  aircraft  under  certain  flight  condition  [19], 


"*i  * 

0 

*2 

-0.0012 

23 

0.0002 

M  - 

0 

14.3877  0 

-0.4217  1.0000 

-0.3816  -0.4658 

0  1.0000 


-31.5311  " 

’*1  " 

'  4.526  ' 

-0.0284 

22 

+ 

-0.0337 

0 

23 

- 1.4566 

0  _ 

.24  - 

0  _ 

The  states  zu  z2,  z3  and  z4  are  the  velocity,  the  angle  of  attack,  the  pitch  rate  and  the  Euler  angle 
rotation  of  aircraft  about  the  inertial  y-axis,  respectively.  The  control  v  is  the  elevator  input, 
which  is  bounded  by  10°,  or  0.1745  rad.  With  a  state  transformation  of  the  form  x  =  Tz  and  the 
input  normalization  such  that  the  control  is  bounded  by  1,  we  obtain 


xn  r^!  0 1 M  n>i- 

.  =  ‘  .  +  ,  sat(u  +  w) 

_*^2  J  L  ®  -^2 J  \_p2_ 


where 


and 


A 1  = 


"  0.0212 

0.1670" 

-  0.4650 

0.6247" 

-0.1670 

0.02 12_ 

2  L~  0-6247 

-  0.4650_ 

8.28561  T  0.7584" 

-  2.4303J’  2  _  L  -  1-8562 


The  system  has  two  stable  modes  —  0.4650  ±  0.6247i  and  two  anti-stable  ones,  0.0212  ±  0.16701. 
Suppose  that  w  is  bounded  by  |w|  ^  D  =  2. 

For  the  anti-stable  xr subsystem,  we  take  y1  =  0.9.  With  the  technique  in  Section  5,  we  obtain 
a  feedback  u  =  fiXu  where  fx  —  [  —  0.4335  0.2952],  such  that  Qi(yi)  (as  defined  in  (38))  is  inside 
some  invariant  set  Sfj,  Moreover,  for  all  initial  x10  e  under  the  control  u  ~fiXu  xi(t)  will 
enter  a  ball  Xi  =  {*i  eR2:  ||xx  ||2  <  29.8501}.  In  Figure  7,  the  outermost  dotted  closed  curve  is 
the  boundary  of  the  null  controllable  region  the  inner  dash-dotted  closed  curve  is  the 
dashed  closed  curve  is  and  the  innermost  solid  closed  curve  is  dfa. 

The  x2-subsystem  is  exponentially  stable.  Under  the  saturated  control,  it  can  be  shown  that  for 
any  initial  value  x20  e  R2,  there  exists  a  T  >  0  such  that  x2(t)  will  enter  a  bounded  ball  at  time 
T  and  remain  there.  The  bounded  ball  is  computed  as 


X2  =  {x2eR2:  ||x2||2<4}. 
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Figure  7.  Design  partial  feedback  u  =fxXi  such  that  D/yd  c:  y>v 


Figure  8.  A  trajectory  of  xx  with  e  =  0.03,  k  =  2.5. 


We  see  that,  for  any  (x10,  x20)  R2,  under  the  partial  feedback  control  u  =  fxxu  the  state 

(xi,  x2)  will  enter  the  set  X\  x  Xz  in  a  finite  time  and  remain  there.  The  next  step  is  to  design  a  full 
state  feedback  to  make  the  set  Xi  x  Xi  inside  the  domain  of  attraction  of  an  arbitrarily  small  set. 
Choose  £  =  0.03,  we  get 


0.9671 

0.0005 

-  0.0686 

0.0375 

0.0005 

0.9664 

0.0345 

-  0.0410 

-  0.0686 

0.0345 

4.1915 

-  0.7462 

0.0375 

-  0.0410 

-  0.7462 

11.3408 

/(e)  =  0.001  x  [  —  0.0729  1.408  -  36.4271  33.6402],  and  £fp(e)  =  {xeR4:xT(e)x  <  10.3561}.  It 
can  be  verified  that  Xi  x  Xi  c  This  implies  that  under  the  control  u  =  /xj,  the  state  will 
enter  at  a  finite  time.  If  k  is  sufficiently  large,  then  under  the  control  u  —  kf(s)x ,  £fp(e)  will  be 
an  invariant  set.  In  this  case,  the  switching  controller  (43)  is  well  defined. 

The  final  step  is  to  choose  k  sufficiently  large  such  that  the  state  will  converge  to  an  arbitrarily 
small  subset.  We  illustrate  this  point  by  simulation  results  for  different  values  of  k.  In  the 
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simulation,  we  choose  w(£)  =  2 sin (0. It)  and  x10  to  be  a  point  very  close  to  the  boundary  of  «9j,  see 
the  point  market  with  ‘o’  in  Figures  8  and  10.  We  also  set  x20  =  [1000  1000] T,  which  is  very  far 
away  from  the  origin.  When  k  =  2.5,  the  disturbance  is  not  satisfactorily  rejected  (see  Figure  8  for 
a  trajectory  of  xx  and  Figure  9  for  the  time  response  of  ||x(f)||2).  When  k  =  30,  the  disturbance  is 
rejected  to  a  much  higher  level  of  accuracy  (see  Figures  10  and  1 1). 


8.  CONCLUSIONS 

For  linear  exponentially  unstable  systems  subject  to  actuator  saturation  and  input  additive 
disturbance,  we  have  solved  the  problem  of  semi-global  practical  stabilization.  We  have  assumed 
that  the  open-loop  system  has  only  two  anti-stable  modes  and  our  results  generalized  the  existing 
results  on  systems  that  do  not  have  any  exponentially  unstable  poles.  Our  analysis  relies  heavily 
on  limit  cycle  theory  and  vector  fields  analysis  of  the  exponentially  unstable  subsystem.  It  is  not 
expected  that  our  results  can  be  further  extended  in  a  direct  way  to  systems  with  more  than  two 
exponentially  unstable  open-loop  poles. 


APPENDIX  A:  PROOF  OF  LEMMA  1 


Since  at  the  intersection  p',  the  trajectory  goes  downward,  so^n  <  -  a2/k.  Using  the  fact  that 
fp  =  fp '  =  l/k  and  pr  =  eATp,  we  have 


C0*VT[^‘] 

[Oqe-'pl'j 


=  l 

=  l 


(Al) 

(A2) 


From  (Al)  and  (A2),  x12  and  yn  can  be  expressed  as  functions  of  T.  In  other  words,  xxx  and 
yx  i  are  related  to  each  other  through  the  parameter  T.  Since  the  domain  of  valid  Xi  x  can  be  finite 
or  infinite  depending  on  the  location  of  the  eigenvalues  of  A,  it  is  necessary  to  break  the  proof  for 
different  cases.  We  will  see  later  that  the  relation  among  xll9  yxx  and  T  are  quite  different  for 
different  cases. 

Case  1: 


ro  -wi 

Li  *i  +  ^J 

has  two  different  real  eigenvalues  Xu  X2>  0.  Assume  that  Xx  >  X2. 
Let 


then 


V~ 1 
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From  (Al)  and  (A2)  we  have 


1  —  A2  +  >^2eA2r  —  A\ZXlT 

Xll(  }~  k  e^T-eA*T 

lX1-X2  +  X2e^T-X1e~^ 
yiiK1)  —  ^  e-A,  r_e-A2r 


(A3) 


(A4) 


Due  to  the  uniqueness  of  the  trajectory,  T  is  also  uniquely  determined  by  xn.  So,  Xu<-+T, 
*11  ++yxu  yn++T  are  aH  one  t0  one  i^aPs-  From  the  above  two  equations,  we  know  that  xn(T) 
and  yn(T)  are  analytic  on  (0,  oo).  It  can  be  verified  from  (A3)  that 

X\  +  A2 


lim  xlx  =  — 
r->o 


r  ^1 

,  hrn  xn  = 
k  t-  oo  k 


k  K  T-*  oo 

so  we  know  the  valid  domain  of  xx  t  is  (  —  a2/k ,  am).  It  can  also  be  verified  that  dxi  x/dT  >  0,  or 
dr/dxu  >  0. 

Denote  ^(F):=  —  dyu/dxn,  then 

m  At  -  A2  +  A2e,,'r  -  AteAjr 
^  ^  ~  A,  -  A2  +  A2e-^r  -  A,e-^T 
It  can  be  verified  that  limr^o0(F)  =  1  and 

-  A1A2(eA,r  —  g*;r) _ 

dT  (A!  -  A2  +  A2e-^T  -  A,e-^r)2  '  ; 

where  h(T)  -  (A2  —  A2)(l  -  e-(Al  +  A,)T")  +  (Ax  +  A2)  (e_A‘T  -  e“ AlT).  Since  h( 0)  =  0  and 

^  =  (Ai  +  A2)e-<A-  +«(A,  -  A2  +  A2eA‘r  -  A^)  >  0 

for  all  T  >  0,  we  have  h(T)  >  0,  hence  dg/dT  >  0.  This  shows  g(T)  >  1  for  all  T  >  0,  i.e. 
dyn/dxn  <  — 1.  Since  dg/dT  =  dg(T)/dxn  •  dxu/dT  =  —  d2yll/dxj1  -dxn/dT,  and  dg/dT  >0, 
dxn/dT  >  0,  it  follows  that 

d^n/dxu  <0 

Case  2: 

"0  -  A2' 

1  2A 


y4  = 


] 


has  two  identical  real  eigenvalues  X  >  0. 
Let 


then 


In  this  case 


aAT 


:] 

-[:  ;]■■■ 


-VT 


xll(T)  =  ~  —  (l+AT-e-27) 
yu(T)  =  ^(l-AT-eAr) 
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Similar  to  Case  1,  it  can  be  shown  that 

XX  #2  , .  X 

lim  xn  =  --=-T,  lim  Xu  =  --  =  fl„ 
t-o  k  k  t-+°o  k 

so  the  valid  domain  of  xti  is  (  —  a2/k,am).  It  can  also  be  verified  that  dxn/dT  >  0.  Denote 
g{T):—  -dyu/dxu,  then 

1  -eXT  +  XTeXT  . 

d(T)  ,  _  —  XT  i-r.-lT  >  d{T)  —  1 


and 


1  -  e 


■XTe 


T-oo 


X2T 


;h(T) 


d 7  (1  -e~XT -XTe~XT)2 

where  h(T)  =  eXT  —  t~XT  —  2 XT.  It  can  be  shown  that  h(T)  >  0,  hence  dg/dT  >  0.  The  remaining 
part  is  similar  to  Case  1. 

Case  3: 

(«2  +  /?T 

2a 

has  two  complex  eigenvalues  a  ±  j/J,  a,/}  >  0. 

Let 


_  j”o  -(«2  +  /?2)J 


V 


-a 
0  1 


then 

From  (Al)  and  (A2)  we  have, 
*ii (T)  ■■ 


eAT  =  V 


1 


cos  /?T  —  sin  ($T 

sin  /?T  cos  /IT 


>- 


-le«T 


/csin  $T 


yn(T)~ 


i 


(  —  P  cos  PT  —  asin/?T  +  pQ  aT) 


;{p  cos  PT  —  asinjST  —  /?eaT) 


/csin  PT 

The  valid  domain  of  T  is  (0,  n/p\  this  can  be  obtained  directly  from  the  vector  field  and  also 
from  the  above  equations.  Notice  that 


r  /an  2a  a2 

lim  xn(7)=  — —  =  — — , 

T^0  K  /C 


lim  xu(T)=  oo 

So  we  have  am  =  oo  in  this  case. 

Define  g(T)  similarly  as  in  Case  1,  we  have 

p  +  (a  sin  pT  —  P  cos  pT)caT 


9(T)  = 


P  —  (a  sin  PT  +  /?cos  /?7)e 


-aT 


and 


d<? 


(a2  -f  /?2)sin  PT 


,  lim  g(T)  =  1 


rh(T) 


d T  (/J  —  (a  sin /IT  +  /?cos/?T)e  aT)2 
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where  h(T)  =  fidtT  —  fie  aT  —  2a  sin  fiT.  It  can  be  verified  that  /i(0)  =  0,  dh/dT  >  0,  thus 
dg/dT  >  0  for  all  T  e  (0,  n/fi).  The  remaining  part  is  similar  to  case  1.  □ 


APPENDIX  B:  PROOF  OF  LEMMA  2 

Similar  to  the  proof  of  Lemma  1,  from  (14),  we  can  express  xx  x  and  x  as  functions  of  T,  Xj  j(T) 
and  ,yu(r).  Clearly  these  functions  are  analytic.  Denote 

dy.CTdT 

91  ’  dxlt(T)/4T 

It  suffices  to  show  that  cbcu/d T  >  0,  g(T)  >  1,  and  dg/dT  >  0.  We  need  to  break  the  proof  into 
three  different  cases. 

Case  1: 


a  __  0  —  X\X2 

Li  -W1  +  J2L 


has  two  different  real  eigenvalues  -  Xu  -  X2  <  0.  Assume  that  Xx  >  X2. 
Let 


F  =  P2  Xl 
1  1_ 


then 


e  =  V 


-X,  T 


0  e 

From  (14)  and  the  fact  that  kfp'  —  1,  kfp  =  —  1,  we  have 

„  /^_iX2-X1  +  X2e-^T-X1e-^T 

Xli{T)~k  - 

..  ,^_1X2-X1+X2ex>T-X1el>T 
yii{T '  k  e2>r-e2>r 

and 


(Bl) 

(B2) 


X2  —  X1+X2Z  XiT—Xlt~XlT 

TO 

By  the  definition  of  Td,  yii{Td)  =  a2/k  =  —  (A,  +  A2)//c.  It  can  be  shown  that  as  T -*•  Td, 
g(T)  -►  00.  Since  g(0)  =  1  and 

dg  _  2AXA2 

dT  ~  (A2  -  A,  +  A2e2'T  -  A^7)2 

x  {Ui  +  ^2)  [ch  (AXT  -  A2T)  -  1]  +  (X2  -  Aj)  [ch  (A2T)  -  ch(A,  T)])  >  0 

where  ch(«)  =  (ea  +  e-fl)/2  ^  1  is  monotonously  increasing,  we  have  that  g(T)  >  1  for  all 
T  e  (0,  Td). 

It  can  also  be  verified  that  dxn/dT  >  0.  The  remaining  proof  is  similar  to  Appendix  A. 


Case  2: 


A  = 


■A2' 

2A 
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has  two  identical  real  eigenvalues. 
Let 


then 


~AT 


--[! :] 
-t:  ii- 


-le-AT 


In  this  case. 


xn(T)  =  -  —  (l-XT  +  eXT) 
yu(T)  =  -^f(l  +  XT  +  e-XT) 


and 


Since  g(0)  =  1  and 


g(T)  = 


1  +  XTe~XT  +  e~XT 


1  —  XT  eXT  +  eXT 

d g  X2T(2XT +  eXT -e~XT) 

d T~  (1  -  XTeXT  +  eAT)2 


>0 


we  have  g(T)  >  1  for  all  T  e(0,  Td).  It  can  be  verified  that  dxn/dT  >  0. 
Case  3: 

'0  —  (a2  +  p2f 


=  ~0  —  (a2  +  P2)~ 

_i  -  2a 


has  two  complex  eigenvalues  —  a  +  j/J,  a,  /?  >  0. 
Let 


then 


In  this  case, 


=  ~P  a 
0 


aAT 


cos  PT  —  sin  PT 
sin  PT  cos  PT 


V -1 


-ie-«r 


1 


Xn(T)  =  cos pT  -  asm pT  +  pe*T) 

/csinp  i 


yn(T)=- 


1 


fesin  PT 


(ftcosfiT  +  ccsinpT  4-  Pc  aT) 


and 


P  +  (P  cos  PT  +  asm  pT)e~aT 

0\T)  —  o,(o  prr  '  Orr\  aT  9  i  ^  (0,  7^) 

P  +  (P  cos  PT  —  a  sin  pT)eai 
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Since  g( 0)  =  1  and 


d g_ 
d  T 


a2  +  P2 


(P  +  (p  cos  pT  -  a  sin  pT)  e“r)2 


[2a sin2 pT  +  P(eaT  -  e_<i:r)sin pT ]  >  0 


we  have  g(T)  >  1  for  all  T  e  (0,  Td).  It  can  also  be  verified  that  dx1  JdT  >  0. 

For  all  the  above  three  cases,  Since  g(T)>  1,  i.e.  dyu/dT  >  dxn/dr  for  all  T  and 
limr_0  Xn(T)/yi  t(T)  =  1,  we  finally  have  yx  i  >  xu . 
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A  Complete  Stability  Analysis  of  Planar 
>  Discrete-Time  Linear  Systems  Under  Saturation 

Tingshu  Hu  and  Zongli  Lin,  Senior  Member,  IEEE 


Abstract — A  complete  stability  analysis  is  performed  on  a  planar 
discrete-time  system  of  the  form  x(k  + 1)  =  sat  (Ax(fc)),  where 
A  is  a  Schur  stable  matrix  and  sat  is  the  saturation  function. 
Necessary  and  sufficient  conditions  for  the  system  to  be  globally 
asymptotically  stable  are  given.  In  the  process  of  establishing  these 
conditions,  the  behaviors  of  the  trajectories  are  examined  in  detail. 

Index  Terms — Limit  trajectories,  neural  networks,  saturation, 
stability. 


stability  analysis  of  planar  systems  of  the  form  (1).  In  partic¬ 
ular,  necessary  and  sufficient  conditions  for  the  system  to  be 
GAS  will  be  identified.  In  the  process  of  establishing  these  con¬ 
ditions,  the  behaviors  of  the  trajectories  are  examined  in  detail. 

This  work  is  motivated  by  our  recent  result  [4]  on  the  planar 
continuous-time  system 

x  =  sat(Ax),  x  E  R2.  (3) 


L  INTRODUCTION 

DYNAMICAL  systems  with  saturation  nonlinearities  arise 
frequently  in  neural  networks,  analogue  circuits  and  con¬ 
trol  systems  (see,  for  example,  [9],  [5],  [2],  [6]  and  the  refer¬ 
ences  therein).  In  this  paper,  we  consider  systems  of  the  fol¬ 
lowing  form: 

x(k  + 1)  =  sat(Ar(fc)),  x  6  Rn  (1) 

where  sat  Rn  — ►  Rn  is  the  standard  saturation  function.  With  a 
JP'&ght  abuse  of  notation,  we  use  the  same  symbol  to  denote  both 
'^fae  vector  saturation  function  and  the  scalar  saturation  function, 


i.e.,iU>  €  Rn,  then  sat  (v)  =  [sat(ni),sat(i>2),  •  • 
and 

. ,  sat(un)]T 

1 

5 

A 

1 

i-j 

sat(vj)  =  <  Vi,  if  —  1  <  Vi  <  1 

(2) 

1 1,  if  Vi  >  1. 

Systems  of  the  form  (1)  and  their  continuous-time  counterparts 
mainly  arise  in  neural  networks  and  in  digital  filters. 

As  with  any  dynamical  system,  stability  of  these  systems  is 
of  primary  concern  and  has  been  heavily  studied  in  the  literature 
for  a  long  period  of  time  (see,  for  example,  [1],  [7]— [1 1]  and  the 
references  therein).  As  seen  in  the  literature,  the  stability  anal¬ 
ysis  of  such  systems  are  highly  nontrivial  even  for  the  planar 
case.  For  the  continuous-time  counterpart  of  (1),  only  until  re¬ 
cently  have  the  necessary  and  sufficient  conditions  for  global 
asymptotic  stability  (GAS)  been  established  for  the  planar  case 
[4].  For  the  planar  discrete-time  system  of  the  form  (1),  to  the 
best  of  our  knowledge,  no  necessary  and  sufficient  conditions 
have  been  known,  although  various  sufficient  conditions  are 
available  [9],  [1 1].  This  paper  attempts  to  carry  out  a  complete 
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However,  the  two  systems  (1)  and  (3)  behave  quite  differently 
even  though  they  have  a  similar  description.  First  of  all,  (3)  op¬ 
erates  on  the  entire  plane  while  (1)  operates  only  on  the  unit 
square.  The  trajectories  of  (3)  do  not  intersect  each  other  but  the 
connected  trajectory  of  (1)  [by  connecting  x(k)  and  x{k  +  1)] 
can  intersect  itself.  The  limit  trajectories  of  (3)  must  be  periodic 
but  a  limit  trajectory  of  (1)  need  not  be.  Finally,  it  is  known  that 
in  the  stability  analysis  for  nonlinear  systems,  many  more  tools 
are  available  for  continuous-time  systems  than  for  discrete-time 
systems. 

We  will  start  our  investigation  of  the  planar  system  (1)  by 
characterizing  some  general  properties  of  its  limit  trajectories. 
An  important  feature  is  that  a  nontrivial  limit  trajectory  can  only 
intersect  two  opposite  pair  of  boundaries  of  the  unit  square  and 
it  cannot  have  intersections  with  both  of  the  neighboring  bound¬ 
aries.  This  result  turns  our  attention  to  a  simpler  system  which 
has  only  one  saturated  state 


1)  = 


auXi(k)  +  ai2X2(k) 
sat  (a2i#i(fc)  +  d22^2{k)) 


(4) 


For  this  simpler  system,  we  will  establish  a  relation  between  the 
present  intersection  of  a  trajectory  with  the  lines  x2  ==  ±1  and 
the  next  one  in  terms  of  a  set  of  points  on  the  line  x2  =  1.  The 
relation  is  discontinuous  but  piecewise  linear.  The  set  of  points 
are  the  places  where  the  discontinuity  occurs.  Some  attractive 
properties  about  these  points  and  the  relation  between  the  next 
intersection  and  the  present  one  are  revealed.  These  properties 
help  us  to  establish  the  condition  for  the  system  (4)  to  be  GAS 
and  to  characterize  an  interval  on  the  line  x2  =  1  from  which  the 
trajectories  of  (4)  will  converge  to  the  origin.  This  in  turn  leads 
to  our  final  result  on  the  necessary  and  sufficient  conditions  for 
the  GAS  of  a  planar  system  of  the  form  (1). 

This  paper  is  organized  as  follows.  In  Section  II,  we  give  the 
necessary  and  sufficient  conditions  for  the  GAS  of  the  planar 
system  in  the  form  of  ( 1).  An  example  is  also  given  to  help  inter¬ 
pret  these  conditions.  These  conditions  are  established  in  Sec¬ 
tions  IH-V.  In  the  process  of  establishing  these  conditions,  the 
intricate  properties  of  the  system  trajectories  are  also  revealed. 
In  particular.  Section  III  reveals  some  general  properties  of  the 
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possible  limit  trajectories  of  the  system  which  help  us  to  ex¬ 
clude  the  existence  of  limit  trajectories  under  the  condition  of 
-  •>,  main  theorem  and  focus  our  attention  to  the  simpler  system 
..  ,th  one  saturated  state.  Section  IV  investigates  system  (4)  and 
gives  a  necessary  and  sufficient  condition  for  the  system  to  be 
GAS.  Section  V  proves  the  main  result  of  this  paper.  Finally,  a 
brief  concluding  remark  is  made  in  Section  VI. 

II.  Main  Results 

Consider  the  following  system: 

x(k  + 1)  =  sat(Ax(fc)),  x  <E  R2  (5) 

where  A  =  012 1  and  sat:  R2  — >  R2  is  the  saturation  func- 

tion,  i.e.,  if  v  €  R2,  then  sat(u)  =  [£g£j]  and  sat(-)  is  as 
defined  by  (2). 

Given  an  initial  state  x(0)  =  x0,  denote  the  trajectory  of 
the  system  (5)  that  passes  through  x0  at  k  =  0  as  ip{k,  x0). 
In  this  paper,  we  only  consider  the  positive  trajectories.  Hence, 
throughout  the  paper,  k  >  0. 

Definition  2.1:  The  system  (5)  is  said  to  be  stable  at  its  equi¬ 
librium  xe  =  0  if,  for  any  e  >  0,  there  exists  a  S  >  0  such 
that,  || ip(k,  x0)||  <  e,  for  all  k  >  0  and  ||x0||  <  S.  It  is 
said  to  be  globally  asymptotically  stable  (GAS)  if  xe  =  0  is  a 
stable  equilibrium  and  li mfc_,00i/,(^>  xo)  =  0  for  all  xo  €  R2- 
Also,  it  is  said  to  be  locally  asymptotically  stable  if  it  is  stable 
^pl  limfc_oo  t/j{k,  x0)  =  0  for  all  xq  in  a  neighborhood  Uq  of 

The  system  is  GAS  only  if  it  is  locally  asymptotically  stable, 
which  is  equivalent  to  that  A  has  eigenvalues  inside  the  unit 
circle.  In  this  case,  A  is  said  to  be  Schur  stable,  or  simply  stable. 
In  this  paper,  we  assume  that  A  is  stable.  Denote  the  closed  unit 
square  as  S  and  its  boundary  as  <?S.  It  is  easy  to  see  that  no 
matter  where  x(0)  is,  we  always  have  x(l)  €  S.  Hence,  the 
global  asymptotic  stability  is  equivalent  to  limfc_,0oV’(^:)  ®o)  = 
0  for  all  i0£S.  The  main  result  of  this  paper  is  presented  as 
follows: 

Theorem  2.1:  The  system  (5)  is  globally  asymptotically 
stable  if  and  only  if  A  is  stable  and  there  exists  no  x0  €  dS  and 
N  >  0  such  that  xo )  =  ±Xo  and  tp{k,  xo)  —  Akx 0  €  S 

for  all  k  <  N. 

If  i/>(k,  x0)  =  Akx0  E  S  for  all  k  <  N,  then  fi{N,  x0)  = 
sat(AA'x0).  Hence,  this  theorem  can  be  interpreted  as  follows. 
Assume  that  A  is  stable,  then  the  system  (5)  is  GAS  if  and  only 
if  none  of  the  following  statements  are  true. 

1)  There  exist  N  >  1  and  <4,  d2  >  0  such  that 

A"]1]  =±f?  +  <M  andAfcf}leS  Vk<N. 
1  1  +  «2  J  L  . 

2)  There  exist  N  >  1  and  <h,  d2  >  0  such  that 


-ll  _  -1  -di 

1  1  +  d2 


3)  There  exist  N  >  1,  d2  >  0  and  xx  e  (-1,  1)  such  that 


an 

Xi 
m  1 

=  ± 

Ak 

Xi 

es 

_  1 

Xi 

1  +  ^2 


4)  There  exist  N  >  1,  di  >  0  and  x2  6  (-1,  1)  such  that 


1  _  l  +  ^i 

x2  J  X2 

1leS  Vk  <  N. 
C2. 


Each  of  the  above  conditions  implies  that  there  is  a  simple 
periodic  trajectory  that  starts  at  some  x0  with  period  N  or  2 N. 
The  trajectory  stays  inside  S  as  that  of  the  corresponding  linear 
system  for  the  first  N  -  1  steps,  and  when  the  linear  trajec¬ 
tory  goes  out  of  S  at  step  N,  the  saturation  function  makes 
i/;(jV,  xo)  =  sat(AjVxo)  return  exactly  at  xo  or  -xo-  These 
conditions  can  be  verified.  Since  A  is  stable,  there  exists  an  in¬ 
teger  No  such  that  Afcxo  €  S  for  all  k  >  No  and  all  xo  6  9S. 
Hence,  it  suffices  to  check  the  four  conditions  only  for  N  <  N0. 

Conditions  1)  and  2)  are  very  easy  to  check.  As  to  3)  or  4), 
for  each  N,  at  most  two  x[s  can  be  solved  from 

To  see  this,  denote  the  elements  of  AN  as  ( ANfij ,  i,  j  =  1,  2. 
Then  from  3),  we  have 

(AAr)uXi  +  ( AN)i2  =  ±Xi.  (6) 

If  (Aw)u  /  ±1,  then  there  are  two  xfs  that  satisfy  (6).  If 
(An)  11  =  ±1,  we  must  have  (Aw)i2  7 1  0-  Otherwise  AN 
would  have  an  eigenvalue  ±1,  which  is  impossible  since  A  is 
stable.  In  this  case,  (6)  has  only  one  solution.  It  remains  to  check 
if  d2  >  0  and 

Ak  h1!  €S  Vk  <  N. 


In  the  process  of  proving  Theorem  2.1,  we  will  develop  a 
more  efficient  method  to  check  the  conditions. 

Example  2.1:  Consider  (5)  with 

_  [  1.5840  —1,3990* 

A~~  [  3.9702  -2.9038  _  * 

The  following  results  are  presented  with  accuracy  up  to  four 
decimal  digits.  There  are  two  points  on  9S  that  satisfy  condition 
3),  one  with 

*‘  =  T^fe  =  0ra08 


and  the  other  with 


AM  ",  €  S  \/k  <  N. 
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But  there  are  four  periodic  trajectories  as  listed 

[0.7308]  [-0.2414]  [  -0.3791' 

1  [  1.0000  J  [  -0.0023  J  [-0.9516 

[  0.7308] 

[  1.0000  J 

[0.9028]  [0.0310]  [-0.9028' 

2>  [l.OOOOj  [0.6804J  [-1.0000 

[-0.0310]  [0.9028] 

[ -0.6804 J  1.0000  J 

.  [0.7424]  [-0.2230]  [-0.4145] 

6>  [l.OOOOj  [  0.0438  J  [ -1.0000 J 

[0.7424] 

[l.OOOOj 


Since  the  function  sat(Ar)  is  continuous  in  x,  if  a  trajectory 
Tjj(k,  xq)  returns  arbitrarily  close  to  a;  €  r(xo),  it  will  also 
return  arbitrarily  close  to  sat(Ar).  We  state  this  property  in  the 
following  lemma. 

Lemma  3.1:  If  yo  €  r(rc0),  then  yo)  6  F(x0)  for  all 
k  >  0.  Given  any  e  >  0  (arbitrarily  small)  and  any  integer 
N  >  0  (arbitrarily  large),  there  exists  an  integer  Kq  >  0  such 
that 

\^(k  +  Ko,  xo)-V->(fc,  yo)loo  <e  Vk<N. 

Because  of  Lemma  3.1,  for  yo  €  r(xo)>  ^{k,  yo)  is  called  a 
limit  trajectory  of  ip(k,  xq).  It  is  periodic  if  and  only  if  r(rr0) 
has  finite  number  of  elements. 

The  following  notation  is  defined  for  simplicity.  Denote 

2'hS={[*1]:afl€(-1’  1}1 


[1.0000]  [0.1850]  [—1.0000 

4'  [l.OOOOj  [l.OOOOj  [-1.0000 

[-0.1850]  [  1.0000] 

[-l.OOOOj  [l.OOOOj  * 

In  the  third  periodic  trajectory,  the  first  coordinate  xi  =  0.7424 
of  the  initial  state  is  computed  from 


Q12  —  flu  C^2)  12 
aii(A2)u  “  1 


=  0.7424. 


ft  should  be  noted  that  4)  is  the  only  stable  periodic  trajectory. 
As  we  can  see  from  the  example,  there  are  other  kinds  of  peri¬ 


odic  trajectories  than  what  are  inferred  by  the  conditions  1)~4), 
e.g.,  trajectories  3)  and  4).  There  may  also  be  trajectories  that 
neither  are  periodic  nor  converge  to  the  origin.  We  will  prove  in 
the  subsequent  sections  that  if  none  of  the  conditions  1)— 4)  is 
true,  then  there  exist  no  nonconvergent  trajectory  of  any  kind. 


III.  Limit  Trajectories 

To  prove  that  (5)  is  GAS,  we  need  to  show  that  the  only 
limit  point  of  any  trajectory  is  the  origin.  It  is  known  that  A 
being  stable  alone  is  not  sufficient  to  guarantee  the  GAS  of  the 
system.  Actually,  it  is  well-known  [9]  that  the  system  may  have 
stationary  points  other  than  the  origin;  there  may  be  periodic 
trajectories  and  even  trajectories  that  neither  are  periodic,  nor 
converge  to  a  stationary  point.  In  this  section,  we  are  going  to 
characterize  some  general  properties  of  the  nonconvergent  tra¬ 
jectories.  These  properties  will  facilitate  us  to  exclude  the  exis¬ 
tence  of  such  nonconvergent  trajectories  under  the  condition  of 
Theorem  2.1. 

Since  every  trajectory  is  bounded  by  the  unit  square,  there 
exists  a  set  of  points  such  that  the  trajectory  will  go  arbitrarily 
close  to  them  infinitely  many  times. 

Definition  3.1:  For  a  given  xo  G  R2,  a  point  x*  G  R2  is 
^lled  a  (positive)  limit  point  of  the  trajectory  xo)  if  there 

exists  a  subsequence  of  il>(k,  #o  2,  ...,such 

that  Hindoo  £o)  =  %*•  The  set  of  all  such  limit  points  is 
called  the  limit  set  of  the  trajectory.  We  denote  this  limit  set  as 

r(a?0). 


^  ■{[*»] :  ** 6  (-1, 

We  see  that  Lh  and  -X*,  are  the  two  horizontal  sides  of  S,  and 
Lv  and  —  Lv  are  the  two  vertical  sides  of  S.  Notice  that  they 
do  not  include  the  four  vertices  of  the  unit  square.  Also,  denote 
v1  =  [[],  v2  =  [~~\]  as  the  two  upper  vertices  of  the  square. 

Let  y0  be  a  limit  point  of  some  trajectory  and  for  simplicity, 
let  yk  =  ip(k,  yo).  Denote  Y  —  {±yk‘  k  >  0}  and  AY  = 
{±Ayh‘  k  >  0}.  Clearly,  Y  must  have  an  intersection  with  the 
boundary  of  the  unit  square.  If  Y  n  Lh  is  not  empty,  define 

7x  =  inf  |a?i:  j^1  eY  D  ( Lh  U  {/i/i,  V2})  j 

and 

72  =  sup  jxi:  eY  O  (Lh  U  {vx,  v2})  j  . 

If  Y  CiLv  is  not  empty,  define 

73  =  sup  l  x2:  }  G  Y  H  (Lv  U  {v1?  -v2}) 

L  1*^2  _ 
and 

74  =  inf  |x2:  G  Y  fl  ( Lv  U  (t;i7  — v2})| . 

The  following  proposition  shows  that  a  limit  trajectory  can 
only  intersect  one  opposite  pair  of  the  sides  of  the  unit  square, 
not  both  of  the  neighboring  pair.  This  result  will  reduce  our 
problem  to  a  much  simpler  one. 

Proposition  3.1:  Let  yo  be  a  limit  point  of  some  trajectory. 

1)  If  y0  G  Lh,  then  ijj(k,  y0)  will  not  touch  Lv  or  —  Lv  for 
all  k  >  0.  Moreover,  i)(k,  y0)  will  stay  inside  the  strip 

||^^]  :lXll  —  max IItiI)  I72I}}  • 

2)  If  yo  €  Lv,  then  ijj(k,  y0)  will  not  touch  Lh  or  —Lh  and 
will  stay  inside  the  strip 

|  **  :  |x2|  <max{|73|,  |74|}J- 

3)  The  set  Y  cannot  include  both  vx  and  v2. 
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Fig.  1 .  Illustration  for  the  proof  of  Proposition  3.1. 


%  Proof:  The  proof  is  built  up  on  a  simple  geometric  fact. 
Cet  X  be  a  set  in  R2  and  let  AX  be  the  image  of  X  under  the 
linear  map  x  — >  Ax.  Then,  the  area  of  AX  equals  to  the  area  of 
X  times  |det(A)|. 

l)We  first  assume  that  Y  contains  a  finite  number  of  ele¬ 
ments,  i.e.,  ip(N,  yo)  =  yo  for  some  N.  Suppose  on  the  con¬ 
trary  that  the  trajectory  will  touch  Lv  or  —Lv  at  some  step.  The 
main  idea  of  the  proof  is  to  show  that  the  area  of  the  convex  hull 
of  Ay  is  no  less  than  that  of  Y,  which  contradicts  the  fact  that 
|det(A)|  <  1. 

Since  Y  contains  points  on  both  Lh  and  Lv,  7i, 
i  —  1,  2,  3,  4,  are  all  defined. 

If  yk  is  in  the  interior  of  the  unit  square,  then  yk  =  Ayk~i ;  if 
yk  e  Lh,  then  yk  =  sat(Ayfc-i)  and 


Xi 

1  -j-  d 


for  some  \xi\  <  1  and  d  >  0  [note  that  yo  =  Vn  — 
sat(AyTv-i)];  if  Vk  €  Lv,  then 


Ayk-i 


1  -f  -  d 


for  some  \x2\  <  1  and  d  >  0.  If  yk  =  Vi  (or  v2),  then  yk  = 
sat(Ayfc_x)  and 


) 


Ayfc- i 


1  A  d\ 
1  +  d2 


— 1  —  di 

1  ~h  d2 


) 


for  some  di,d2  >  0.  Hence,  AY  contains  all  the  elements  of  Y 
which  are  in  the  interior  of  S,  and  for  those  yk  on  the  boundary 
of  S,  if  yk  £  Ln,  there  is  a  point  in  AY  that  is  just  above  yk  (on 


the  same  vertical  line)  and  if  yk  £  Lv ,  then  there  is  a  point  in 
AY  that  is  just  to  the  right  of  yk  (on  the  same  horizontal  line). 

Denote  the  areas  of  the  convex  hulls  of  Y  and  AY  as  A(y) 
and  A(AY),  respectively.  Also,  let 


7i 

u2  = 

72 

Ui  = 

_  1 

B 1  _ 

'  1  ‘ 

'  1  ’ 

U3  = 

.73. 

U4  ~ 

.74. 

as  shown  in  Fig.  1.  In  the  figure,  the  points  marked  with 
belong  to  AY,  the  polygon  with  dash-dotted  boundary  is  the 
convex  hull  of  AY  and  the  polygon  with  vertices  ,  i  = 
1,  2,  3,  4,  and  some  points  in  the  interior  of  S  is  the  convex 
hull  of  y.  Since  there  is  at  least  one  point  in  Y  that  is  to  the  left 
of  ui,  one  to  the  right  of  ,  one  above  u$  and  one  below  u±9 
the  convex  hull  of  Y  is  a  subset  of  the  convex  hull  of  AY.  (This 
may  not  be  true  if  ui  is  the  leftmost  point  in  Y,  or  if  u<i  is  the 
rightmost).  It  follows  that  A(AY)  >  A(Y).  This  is  a  contradic¬ 
tion  since  A(AY)  =  \  det(A)|A(Y)  and  |  det(A)|  <  1. 

If,  on  the  contrary,  Y  has  a  point  outside  of  the  strip 


{[ 


Xi 

x2 


:  \xi\  <  max 


then,  there  will  be  a  point  in  Y  that  is  to  the  left  of  Ui  (or  on 
the  same  vertical  line  with  m),  and  a  point  to  the  right  of  u2  (or 
on  the  same  horizontal  line  with  u2).  In  this  case,  we  also  have 
A(AY)  >  A{Y),  which  is  a  contradiction. 

Now  we  extend  the  result  to  the  case  that  Y  has  infinite 
many  elements.  Also  suppose  on  the  contrary  that  the  trajectory 
will  touch  Lv ,  -Lv  or  go  outside  of  the  strip  at  some  step.  By 
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Lemma  3.1,  for  any  e  >  0  and  any  integer  N  >  1,  there  exists 
a  Kq  >  0  such  that 

)  +  K0,  x0)  -  ip{k,  r/o)loo  <  6 

for  all  k  <  N  and  in  particular 

\^{K0,  a;0)  -  yo\ 

oo<5 

So,  the  trajectory  ip(k  +  Kq,  %o),  k  >  0,  will  also  touch  (or 
almost  touch)  Lv,  -Lv,  or  go  outside  of  the  strip.  Since  yo  is  a 
limit  point  of  ip{k  +  Ko,  xo),  there  exists  a  jFsTi  >  0  such  that 

+  K0,  x0)  -  j/oloo  <  e- 


Define 


Z{e)  =  {^{k  +  K0,  x0):  0<k<Kx} 
and 

AZ[e)  =  {At/>(k  +  K0,  xo):  0  <  k  <  Ki}  . 


Using  similar  arguments  as  in  the  finite  element  case,  we  can 
show  that 


|det(A)|  = 


A(AZ(s)) 

A(Z(e)) 


>  1  -  0(e). 


Letting  e  ->  0,  we  obtain  |  det( A)  |  >  1,  which  is  a  contradic- 
ion. 

1 2)  Similar  to  1). 

3)  If,  on  the  contrary,  Y  contains  both  vx  and  v2,  then  the 
convex  hull  of  Y  is  S.  Also,  AY  contains  a  point 


Ayj  = 


XX  <  -1  X2  >  1 


and  a  point 


Ayk  = 


XX  >  1  X2  >  1 


The  terms  GAS,  limit  point  and  limit  trajectory  for  (5)  are 
extended  to  (7)  in  a  natural  way. 

For  a  given  initial  state  x(0)  =  x0,  denote  the  trajectory  of  the 
system  (7)  as  ^(k,  xo).  Denote  the  line  =  1  as  Letl,  the  line 
X2  =  -1  as  —  L\  and  the  region  between  these  two  lines  (in¬ 
cluding  ±Leh)  as  Se.  We  will  show  later  that  (7)  has  nontrivial 
limit  trajectory  in  S  if  and  only  if  (5)  has  nontrivial  limit  tra¬ 
jectory  that  intersects  ± La.  In  the  sequel,  when  we  say  “limit 
trajectory,”  we  mean  a  limit  trajectory  other  than  the  trivial  one 
at  the  origin. 

In  this  section,  we  study  the  GAS  of  the  system  (7)  and  will 
also  determine  a  subset  in  Leh  which  is  free  of  limit  points.  Our 
investigation  will  be  based  on  the  study  of  the  linear  system 

x{k  +  1)  =  Ax{k).  (8) 

For  a  stable  continuous- time  linear  planar  system,  if  a  trajec¬ 
tory  stays  in  Se  for  a  whole  cycle  [lx\t)  increases  or  decreases 
by  2?r],  then  x{t)  will  be  in  Se  for  all  t  >  0.  But,  for  the  dis¬ 
crete-time  linear  planar  system  (8),  a  trajectory  might  go  out 
of  Se  after  staying  within  Se  for  several  cycles.  In  the  contin¬ 
uous-time  case,  the  trajectories  never  intersect  but  in  the  dis¬ 
crete-time  case,  the  connected  trajectory  [by  connecting  x(k) 
and  x(k  +  1)]  can  intersect  itself.  These  facts  make  the  anal¬ 
ysis  much  more  complicated  than  the  continuous-time  system 
as  discussed  in  [1],  [3],  [4]  and  [10]. 

A  simple  one  or  two  point  periodic  trajectory  can  be  formed 
if  A[x11  ]  =  for  some  d  >  0.  An  N  or  27V  point  periodic 

trajectory  will  be  formed  if  AJV[X11]  =  ±[^1,  d  >  0  and 
Afc[Xl]  €  Se,  for  all  k  <  N. 

Proposition  4.1:  The  system  (7)  is  GAS  if  and  only  if  A  is 
stable  and  the  following  statement  is  not  true  for  any  xx  €  R: 
There  exist  an  integer  N  >  0  and  a  real  number  d  >  0  such  that 


and 

Ak  M  £  Se  Vfc<JV.  (9) 


hence,  the  convex  hull  of  AY  contains  S.  This  also  leads  to  Let  a3  =  min{|:ri|:  xi  satisfies  (9)},  then  no  limit  trajectory 

A(AY)  >  .4(10,  a  contradiction.  □  can  exist  completely  within  the  strip 


IV.  Systems  with  One  Saturated  State 

Now,  we  are  clear  from  Proposition  3. 1  that  if  there  is  any 
limit  trajectory,  it  can  intersect  only  one  opposite  pair  of  the 
sides  of  the  unit  square,  either  (L^,  — Lh ),  or  (Lv,  —Lv),  not 
both  of  them.  So,  we  only  need  to  investigate  the  possibility  that 
a  limit  trajectory  only  intersects  The  other  possibility  that 
it  only  intersects  ±LV  is  similar.  For  this  reason,  we  consider 
the  following  system: 


1)  = 


anxi(k)  +  a12x2(k) 
sat  (<221X1  (/c)  +  022X2  (k)) 


sat2  (Ax(/c)) . 

)  .  -(7) 

Assume  that  A  =  “**]  is  stable.  If  021  =  0  or  O12  —  0,  it  is 

easy  to  see  that  both  systems  (5)  and  (7)  are  GAS  and  none  of 

the  conditions  l)-4)  following  Theorem  2.1  can  be  true.  So  we 

assume  in  the  following  that  021,  012  7^  0. 


{[sl-N-j. 

Remark:  If  (9)  is  true  for  some  xx,  then  there  will 
be  a  stationary  point  or  periodic  trajectory  such  as 
aio,  Ax o,  ...,  AAr_1xo,  sat2(AiVa;o)  =  x0,  Ax0,  ....  There 
may  also  exist  other  kind  of  limit  trajectories.  Proposition  4. 1 
says  that  if  there  is  no  simple  periodic  trajectory  as  inferred  by 
(9),  there  will  be  no  limit  trajectory  of  any  kind  (except  the  one 
at  the  origin). 

To  prove  Proposition  4.1,  we  need  to  establish  the  relation 
between  the  next  intersection  of  a  trajectory  with  ±L%  and  the 
present  one. 

For  xo  €  Leh,  suppose  that  tp2(k,  x0)  will  intersect  ±Leh  at 
k  =  ki,i  =  1,2,...,  with  0  <  kx  <  k2  <  . . ..  Since  the  trajec¬ 
tory  can  be  switched  to  ~^2(k,  x0)  at  any  k  without  changing 
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its  convergence  property,  we  assume  for  simplicity  that  all  the 
intersections  foik,  xo)  are  in  Leh  (If  not  so,  just  multiply  itwith 
1).  Denote 

=  Wfcij  *o)  xo  =  fMfo,  so)  .... 

We  call  x0,  xj  and  x%  the  first,  the  second  and  the  third  intersec¬ 
tions,  respectively.  We  also  call  xq  and  xj  the  present  and  the 
next  intersections. 

Clearly,  xj  is  uniquely  determined  by  xo-  We  also  see  that  the 
relation  xo  — >  xj  is  a  map  from  L\  to  itself.  To  study  the  GAS 
of  the  system  (7),  it  suffices  to  characterize  the  relation  between 
xo  and  Xg.  Through  this  relation,  we  can  show  that  if  (9)  is  not 
true  for  any  xi,  then  for  every  xo  €  Leh,  the  intersections  xj, 
Xq,  ...  will  move  closer  and  closer  toward  an  interval,  and  all 
the  trajectories  starting  from  this  interval  will  not  touch  the  lines 
±Leh  and  will  converge  to  the  origin. 

Let  xo  €  Leh.  The  next  intersection  of  faik,  xo)  with  Leh 
occurs  at  step  fci  if 

|[0  l]Afelx0|>l 
and 

|[0  l]Afcx0|<l  Vk<ki. 

The  next  intersection  is  Xq  =  xo)  =  sat2(Afclx0)  [or 

— sat2(Afclxo)].  Since  for  different  xo  6  Leh,  the  number  of 
steps  for  the  trajectories  to  return  to  ±L%,  i.e.,  the  number  k\  as 
defined  above,  is  different,  we  see  that  the  relation  between  x0 
'•  \d  Xq  must  be  discontinuous. 

We  will  first  determine  an  interval  on  Leh  from  which  a  tra¬ 
jectory  will  not  intersect  ±L%  again  (no  xj)  and  will  converge 
to  the  origin. 

Since  A  is  stable,  there  exists  a  positive  definite  matrix  P  such 
that 


AtPA  -  P  <  0. 

Define  the  Lyapunov  function  as 

V(x)  :=  xTPx 

then  for  every  x  €  R2,  V(Akx)  <  V(x)  for  all  k  >  1. 

Given  a  real  number  p  >  0,  denote  the  Lyapunov  level  set  as 

£(p)  :=  {x  €  R2:  xT Px  <  p}. 

Let  pc  be  such  that  £{pc)  C  Se  and  £{pc)  just  touches  ±L%. 
In  this  case,  £{pc)  has  only  one  intersection  with  L%.  Let  this 
intersection  be 


If  xo  =  Pc,  then  the  linear  trajectory  Akx o  will  be  inside 
£(Pc)  C  Se.  Hence,  i/>2(k,  x0)  =  sat2(A*xo)  =  Akx 0  for  all 
k  >  0  and  will  converge  to  the  origin.  Since 


Here  we  will  use  a  simple  way  to  denote  a  line  segment.  Given 
two  points  pi,  p2  €  R2,  denote 

[pi>  P2]  :=  +  (1  —  ^)P2-  0  <  A  <  1} 


and  similarly 


(Pl,P2]  =[Pl»P2]\{Pl} 

[Pi>  P2)  =bi.P2]\{P2> 
(pi,P2)  =b>l,P2\\{Pl,P2}. 

Define 


and 


c*o  “  min  jo:  <  etc-  Ak 
| (3  >  ac:  A 


a 


/3o  '■=  max 


€Se 


€  Se 


VA:  >  0 
V  At  >o) 


Since  a2 1  /  0,  the  line  ALeh  :=  {Ax:  x  G  Leh }  has  intersec¬ 
tions  with  both  L\  and  so  there  exist  points  on  both  sides 
of  pc  which  will  be  mapped  out  of  Se  under  A.  Hence  ao  and 
0o  are  finite  numbers.  Now,  let 


Vo 


ao 

1 


<7o  = 


0o 

1 


then,  for  all  x0  €  \p0l  qo],  x0)  -  Akx0  will  converge  to 
the  origin.  Because  of  the  extremal  nature  in  the  definition  of 
ao  and  0Oi  we  must  have  Akp0  6  ±Leh  for  some  k ,  otherwise 
ao  would  not  be  the  minimum  of  the  set  Therefore,  define 


mo  min{fc:  Akp0  G  ±Leh} 


and  similarly 

n0  :=  min{A;:  Akqo  G  ±Leh}. 

If  mo  >  1,  then  by  definition 

|[0  l]Afcp0|<l  VA;  <  mo 

and  by  continuity,  there  exists  a  neighborhood  of  po  such  that 
|[0  l]Afca;o|  <  1,  VA;  <  mo  for  all  x0  in  this  neighborhood. 
Because  of  this,  we  can  define 


ax  :=  min <^a  <  a©:  A 
If  no  >  1,  then  define 

0i  :=  max  1/3  >  0O:  Ak 


eSe  Vfc  <  m0 


G  Se,  Vfccno 


}■ 

}• 


Also,  because  a2\  ^  0,  ai  and  0i  are  finite.  Let 


Pi  = 


ai 

1 


<7i 


01 

1 


)  At PA  —  P  <  0  It  follows  from  the  extremal  nature  in  the  definition  of  ai  and 

0i  that  there  exists  a  k  <  m0  such  that  Akpi  G  ±Z£,  so  we 
there  exists  an  interval  around  pc  in  Lehi  of  nonzero  length,  such  define 
that  for  every  #o  in  this  interval,  ij>2{k,  xq)  —  Akx o,  k  >  1, 
will  never  touch  ±Leh  and  will  converge  to  the  origin. 


mi  :=  min{fc:  Akpx  G  ±Lf [} 
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and  similarly 

rii  :=  min{fc:  Akqi  E  ± L £}. 

'  For  simplicity,  we  denote  [  ]  as  pQ 0  and  [  ]  as  qoo  •  Implied 

by  the  definitions  are  the  following: 

Pi  £  (p  oo?  Po)  3i  €  (50,  <Zoo), 

and 


77l\  <  mo  Til  <  Tlo- 
Inductively,  if  >  1,  then  define 

ai  :=  min  ja  <  1:  A*  j^j  E  Sc 

and  if  Uj- 1  >  1,  define 

:=  max  j/3  >  Ak  E  Se 


Vk  <m, 


VA;  < 


T^j-l  ^  • 


Let 


and 

m*  :=  min{/c:  Afep*  €  ±Leh}  nj  :=  min{A::  Afc<ft  E  ±Leh }. 
Then 


pi  ^  (Pooi  Pt— l)  Qj  €  (ft/— 1>  (7oo)> 

77lj  ^  TTlj — 1  Tlj  ^  Tlj  — 1  • 


The  induction  procedure  ends  if  both  m*  —  1  and  rij  =  1.  We 
denote  the  maximum  index  of  i  as  I  and  the  maximum  index  of 
j  as  J.  As  an  immediate  consequence  of  these  definitions,  we 
have 


ai  <  cti-i  <  •  *  *  <  cxi  <  c*o  <  ac  <  /?o  <  Pi  <  "  * 

<  A/-i  <  /9j 
and 

1  ==m/  <  <  •••  <  mi  <  m0 

1  =  n j  <  nj-i  <  •  •  •  <  ni  <  no* 

We  claim  that  this  set  of  p*,  t  =  0,  1,  2,  . . . ,  and  (ft,  j  = 
0,  1,  . . . ,  7,  forms  exactly  the  set  of  points  where  discontinuity 
occurs  on  the  relation  between  the  next  intersection  of  a  trajec¬ 
tory  with  ± L\  and  the  present  one. 

Lemma  4.1: 

1)  If  xo  E  [po,  qo],  then  ip 2(& ,  x0)  =  will  be  inside 
Se  for  all  k  >  0  and  will  converge  to  the  origin. 

2)  If  #0  £  (Pi-fi,  Pi],  then  the  next  intersection  of 

V>2(/c,  ^o)  with  ±L€h  is  ^2(^1,  Zo)  =  sat2(Arn’'x0); 
If  x0  €  (Poo,  Pi],  then  the  next  intersection  is 
-02(1,  ^0)  =  sat2(Ax0).  Moreover,  Amtpi  E  ±L% 
and  Amix 0  £  Se  for  all  x0  E  (p  003  Pi)- 

j  3)  If  x0  €  [<?j,  gj+i),  then  the  next  intersection  of 

tp2(k,  x0)  with  ±Leh  is  ^(rij,  x0)  =  sat2(Anjx0); 
If  xo  £  [qj,  Qoo),  then  the  next  intersection  is 
^2(1,  £0)  =  sat2(Ax0).  Moreover,  An*qj  €  ±L% 
and  Anix0  Se  for  all  x0  e  ( qj ,  qoo)- 


4)  |[0  l]Afcpj+i|  <  1  for  all  k  <  m-i  and  |[0  l]Am,Pi+i|  > 
1;  |[0  l]Afcg.,+i|  <  1  for  all  k  <  rij  and  |[0  l\Anj  qj+i \  > 
1. 

Proof:  1)  This  is  a  direct  consequence  of  the  definition 
of  po  and  q0. 

2)  From  the  definition  of  rrii,  |[0  l]Akpz\  <  1  for  all  k  < 
rrii  and  [[0  l]Am,pi|  =  1.  Since  A™1  L%  is  a  straight  line  and 
A,n' pc  is  in  the  interior  of  S€,  we  have  |[0  l]A”l,xo|  >  1  for  all 
x0  €  (poo,  Pi)  (Note  that  pe  is  to  the  right  of  pi). 

On  the  other  hand,  since 


ai+ 1  =  min 


■|a  <  a,:  Ak 


a 

1 


e  se 


V  k  <rrii 


} 


we  have  |[0  l]Afcpj+i|  <  1  for  all  k  <  rm.  Also  since  Akpc  is 
in  the  interior  of  Se,  we  have  |[0  l]Afcxo|  <  1  for  all  k  <  rrii 
and  for  all  xo  €  (p»+i,  Pc)- 

Combining  the  above  arguments  we  have,  for  all 
x0  €  (pi+i,  pi],  |[0  l]Am<x0|  >  1  and  |[0  l]A*x0|  <  1 
for  all  k  <  rrii.  This  means  that  the  next  intersection  with  ±L€h 
isV>2(m i,  xo)  =  sat2(Am,xo). 

3)  Similar  to  2). 

4)  This  is  contained  in  the  proof  of  2).  □ 

It  is  obvious  that  sat2(Amtx)  is  a  continuous  function  of  x. 

Lemma  4.1  2)  implies  that  for  all  xq  €  (Pi+i,  Pi],  the  second 
coordinate  of  sat2(Am’  x0),  [0  l]sat2(Am*x0),  is  the  constant  1 
or — 1,  while  the  first  coordinate  remains  linear  on  Xo  -  Similarly, 
for  all  x0  E  [qj,  qj+i),  the  second  coordinate  of  sat2(AnJ‘xo) 
is  the  constant  1  or  -1  and  the  first  coordinate  is  linear  on  Xo- 
Same  relation  holds  for  x0  €  (p<x»  Pi]  and  xo  E  [qi,  <?oo). 

We  will  provide  an  easy  way  to  compute  pi  and  qj  after  re¬ 
vealing  more  properties  about  this  set  of  points.  In  fact,  the  fol¬ 
lowing  properties  will  lead  directly  to  the  proof  of  Proposition 
4.1.  For  xo  E  Leh ,  the  next  intersection  of  ^2(fc,  x0)  with  ±Leh 
can  be  on  L eh  or  on  —L\.  For  simplicity,  we  will  assume  that 
the  next  intersection  is  on  otherwise  we  can  replace  the  state 

x(k )  at  the  intersection  with  -x(ft),  noting  that  we  can  multiply 
the  state  at  any  step  with  —1  without  changing  the  convergence 
rate  of  a  trajectory.  Hence  in  the  following,  when  we  say  that 
£  6  [pi,  qj],  we  mean  x  E  ±\pu  qj]\  and  when  we  say  that 
x  E  ±Ll  is  to  the  left  (or  right)  of  Pi,  it  could  also  be  that  x  is 
to  the  right  (or  left)  of  —pi. 

Denote  p\  =  ^2(^3  Pi)  =  Amipi  and  q)  =  ^2 (%»  Qj)  = 
A71*  qj.  We  see  that  p\  is  the  second  intersection  of  ^2 {k,  pi) 
with  ±L^  (the  first  one  is  pi),  and  qj  is  the  second  intersection 
of  y;2(fc>  Qj)  with  ±L%. 

Lemma  4.2: 

1)  Po,  <7o  e  bo,  ?o]; 

2)  If  p\  €  (qj- 1,  qj],  then  rrii- 1  =  rm  +  n,_i;  if  q)  e 
\?i,  Pi- 1),  then  rij- 1  =  nj  +  mi- u 

3)  For  i  >  1,  Pi  €  (go,  g>»)  and  for  j  >  1,  qj  €  (poo,  Po); 

4)  Pi  e  (pLi,  Qoo),  and  q)  €  (poo,  Qj-i)’, 

5)  Forz,  j  >  l,Pi  andgj  cannot  be  both  in  [pi,  qj],  nor  both 
outside  of  [pi,  qj],  i.e.,  there  must  be  one  of  them  inside 
[pi,  q.j]  and  the  other  one  outside  of  the  interval. 

Proof:  First,  we  give  a  simple  property  arising  from  the 
Lyapunov  function  V(x).  Since  V(x)  is  a  convex  function  and 
pc  takes  the  minimum  value  from  all  x  E  1%,  we  have,  if  both 
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si  and  52  are  to  the  left  of  pc  and  si  is  to  the  left  of  S2,  then 
V(si)  >  V(s2);  if  both  si  and  s2  are  to  the  right  of  pc  and  si 
\to  the  right  of  s2)  then  V(si)  >  V{$2)- 
'  l)Clearly,  pi  cannot  be  to  the  left  of  p0,  otherwise  we  would 
have  V(pl)  =  V(An°p0 )  >  V(p0).  Suppose  on  the  contrary 
that  pi  e  (go,  goo),  then  by  Lemma  4.1  3),  we  would  have 
|[0  l]A"°Am°po|  >  1.  A  contradiction  to  the  definition  of  po- 
Similar  argument  holds  for  go- 

2)  From  Lemma4. 1 4),  the  first  time  Akpi  goes  out  of  Se  is  at 
k  =  rrii-i.  And  by  Lemma  4.1  3)  and  4),  for  xo  G  (ft_i,  ft], 
the  first  time  Akx o  goes  out  of  Se  is  k  =  n3_ i.  Since  p\  = 
Am'Pi  G  (ft_i,  ft]  and  Akpi  G  Se  for  all  k  <  mu  we  have 
mi_i  =  TTii  +  rij-i-  Similarly,  for  g3,  we  have  n3_i  =  n3  + 
mi- 1. 

3)  Similar  to  1),  p]  cannot  be  to  the  left  of  Pi-  Suppose  on 
die  contrary,  that  p\  G  [po,  go],  then  Akpr  never  goes  out  of 
Se.  This  is  a  contradiction  since  An°pi  ^  Se.  Also,  suppose  on 
the  contrary  that  pj  G  | pi-i,  Pi-i-i),  l  >  0,  then  similar  to  the 
argument  in  2),  we  would  have  m»_i  =  mj+nij-i-i  and  hence 
mi-i  >  mi-i-i.  This  is  a  contradiction  since  decreases  as 
i  is  increased.  So,  we  must  have  p\  €  (go,  goo)  and  similarly, 
gj  G  (poo,  Po)- 

4)  Since  Pi  is  to  the  left  of  Pi-i,  we  have 

V(Pi )  >  V(pi-i)  >  V(pc). 


By  3),  p\  is  to  the  right  of  pc,  this  implies 


d  hence 


V(pc)  <  V(pj)  =  V(Am<pi) 


V (Am,'pc)  <  V(pc)  <  V{AmiPi). 


(10) 


Since  pi_i  G  {pi,  pc),  the  point  Amip;_i  is  on  the  line  between 
Amipc  and  Amipi.  Also,  since  the  function  V(x)  is  convex,  it 
follows  from  (10)  that 

y(Amipi_i)  <  max{y(Am,'pe),  V{Amipi)}  =  V{AmiPi). 

Since  mj-i  >  mi,  we  have  y(Ami-lpi_i)  <  V(Am,pi- 1) 
and 


v(p\_  i)  =y(Am-iPi_i)  <  y(Am-pi_i) 

<V(AmiPi)  =  V(pli).  (11) 


By  3),  Pi_x  and  p\  are  both  to  the  right  of  pc,  hence  the  in¬ 
equality  (1 1)  implies  that  p\  is  to  the  right  of  p}_i,  i.e.,  p\  € 


(Pi_i,  goo)- 

Similarly,  we  have  gj  G  (p  007  Qj  —  1/* 

5)  Suppose  that  both  gj,  p\  G  [pi,  qj],  then  by  2)  and  3),  we 
have 


1  =  71  j  +  mi~i  —  mi  +  nj-k2 

where  fci,  k2  >  1.  Since  ra;_i  <  m^k l  and  nj-i  <  it 

follows  that 


m;_ i  <  i  rij-i  <  mj_i 

jhich  is  a  contradiction. 

On  the  other  hand,  suppose  that  both  gj,  p-  £  [p*>  ft],  then 
we  must  have  g j  to  the  left  of  pi  and  p  \  to  the  right  of  g, .  Hence 

y(gj)  >  Vipi)  V(p\)  >  V(qj). 


Recall  that  gj  =  Aniqj  and  p\  =  Amip»,  it  follows  that 

y(gj)  >  V(pd  >  y(pj)  >  V(qj)  >  V{q)) 

which  is  also  a  contradiction.  ^ 

From  1),  3),  and  5)  of  Lemma  4.2,  we  can  see  that  the  only 
pair  of  pi  and  g3  such  that  pj,  gj  €  [p»,  qj]  is  po  and  g0- 
This  fact  can  be  used  to  generate  the  points  Pi,  0,  1 ,  . . . ,  I,  and 
qj ,  j  =  0, 1 , . . . ,  J.  Although  it  is  possible  to  determine  these 
points  directly  from  the  definition,  it  is  hard  to  derive  a  compu¬ 
tationally  efficient  method  to  generate  the  points  from  inside  to 
outside,  i.e.,  frompo,  go  top/,  gj.  In  the  following,  we  provide 
an  iterative  method  based  on  the  properties  in  Lemmas  4.1  and 
4.2  to  generate  the  points  from  outside  to  inside,  i.e.,  from  pj,  qj 
to  po,  go  and  use  the  unique  property  that  pi,  ql  G  [po,  go]  as  a 
sign  to  stop  the  iteration. 


Algorithm  for  Generating  Pi,  qj,  mj,  n3  and 

Pi,  gj 

Step  1  Set  ii  =  1.  Get  the  two  intersec¬ 

tions  of  AL\  with  ±L%.  They  are  p\  and 
—qj  (or  —  Pf  and  qj)  .  Denote  the  line 
segment  of  AL\  between  Leh  and  -~L\  as 
Li .  Multiply  the  two  end  points  of  Li 
from  left  with  A~~l ,  then  we  get  pi  and 
qj .  Clearly,  the  one  to  the  left  of  pc 
is  pi  and  the  one  to  its  right  is  qj .  If 

P/7  Qj  €  \Ph  <&]'  then  1  =  J  =  0  and  stop  the 
algorithm. 

Step  2  ii  —  ii  A  1  •  Check  if  ALa— i  has 
intersections  with  .  If  not,  let 
La  =  ALa- 1  and  repeat  this  step.  If 
there  is,  then  cut  off  the  part  of  ALa- 1 
that  is  outside  of  Se  and  let  the  re¬ 
maining  part  be  La.  The  cut-off  place  is 
one  of  ±p\  and  ±q] .  Multiply  the  cut-off 
place  from  left  with  A~li .  The  result  is 
so  far  the  innermost  Pi  if  it  is  to  the 
left  of  pc/  or  the  innermost  qj  if  to  the 
right  of  pc-  In  the  mean  time,  we  also 
obtain  ttii  ii  and\or  tij  —  ii  •  Let  the  in¬ 
nermost  pair  be  p; ,  qj ,  if  p\,  q)  €  \pi,Qj]f 
then  we  must  have  i  =  j  =  0  and  stop  the 
algorithm  since  all  the  pi,  qj  have  been 
computed.  If  pj,  q)  €  [ft,©]  is  not  true, 

then  repeat  this  step. 

We  see  from  the  above  algorithm  that  the  number  of  iterations 
equals  max{mo,  n0}. 

Item  4)  in  Lemma  4.2  shows  that  [pi-i,  pj-X]  C  [pi ,  pj] 
and  [gL1?  q^ i]  C  [gj,  qjl  Item  5)  shows  that  either  we  have 
\pu  p{]  c  [gj,  qj],  or  [gj,  ft]  C  [pi,  pj]-  Item  3)  shows  that  all 
these  intervals  must  include  [po,  go]-  In  summary,  the  facts  in 
Lemma  4.2  jointly  show  that  the  intervals  [pi,  pj]  and  [gj,  ft], 

i  =  0, 1, . .. ,  I,  j  =  0, 1, _ f  are  ordered  by  inclusion.  We 

can  draw  a  figure  for  easy  understanding  of  Lemma  4.2.  If  we 
draw  arcs  from  pi  to  pj  and  arcs  from  qj  to  gj ,  then  these  arcs 
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Fig.  2.  Illustration  for  Lemma  4.2. 


be  made  not  to  intersect  each  other  (see  Fig.  2).  In  the  figure, 
we  have 

bo,  ?o]  c  \pu  pi]  c  b2,  pW  c  [?i,  <71]  c  b3,  pil- 

Let  $  =  pi)  =  sat2(v4m,'-1Pi),  then  pf  is  the 

third  intersection  of  V^2 (&,  Pi)  with  ±L£.  By  Lemma  4.1  4), 
we  know  that  m;_i  is  the  smallest  integer  k  such  that  Akpi  is 
outside  of  Se.  Also  let  q 2  =  1,  Qj)  =  sat2 (An^~lqj). 

Lemma  4.3:  Suppose  that  (9)  is  not  true  for  any  Xi  £  R, 
then  p?  £  (p»,  p\)  and  q]  £  (g),  ft). 

Proo/;  Suppose  p-  €  (gj,  ft+i],  then  by  Lemma  4.2  2), 
the  smallest  k  for  Akpi  to  go  out  of  Se  is  k  =  m;_i  =  m*  +nj . 
So  pf  =  sat2 {Ami+njpi)  =  sat2(An^Pi).  If  on  the  contrary 
that  p?  €  \p\ ,  g^)  (to  the  right  of  p£),  since  gj  =  An*q$  £ 
is  to  die  left  of  qj,  there  must  be  a  point  x  £  (qj}  p\)  C 
(g,,  £j+i]  such  that  An->x  is  right  above  x ,  i.e.,  sat2(An^x)  = 
a:.  ByLemma4.1  3),  the  next  intersection  of ^{k,  x)  withd=L£ 
is  sat2(Anjx),  so  we  must  have  Akx  €  Se  for  all  k  <  nj  and 
there  exists  x\  such  that  (9)  is  true.  A  contradiction.  On  the  other 
hand,  ifpf  =  sat2(Amf-1pi)  £  (p^,  pi]  (to  the  left  ofp;),  since 
Pi„!  =  Am*  “1pi_i  is  to  the  right  ofpi_i,  there  must  be  a  point 
x  £  [pi7  p^ i)  such  that  Anii~lx  is  right  above  x.  Similar  to  the 
former  case,  we  have  a  contradiction.  Therefore,  p2  £  (p*,  p*), 
and  similarly,  q2  £  (g*,  qj).  □ 

jThis  lemma  says  that  if  a  trajectory  starts  from  p*  or  qj,  its 
third  intersection  with  ±L\  will  be  closer  to  the  central  interval 
[po ,  go]  than  the  first  intersection  or  the  second  one.  We  will 
show  in  the  next  lemma  that  this  property  can  be  actually  ex¬ 
tended  to  all  x  £  Leh. 


Lemma  4.4:  Assume  that  the  condition  (9)  is  not  true  for  any 
xi  £  R.  Given  x(0)  =  xo  £  L Let  Xq  and  x\  be  the  second 
and  the  third  intersection  of  the  trajectory  ^2( k ,  xo)  with  L\, 
(if  the  intersections  are  on  — L% ,  then  get  symmetric  projections 
on  LI).  If  xo  £  (poo,  po],  then  x J  £  (x0,  g<x>)  and  one  of  the 
following  must  be  true. 

1)  Xq  £  (po,  go)  and  there  is  no  third  intersection  x§; 

2)  arj  €  (a*,  Po]; 

3)  xl  €  [go,  ?oo)  and  e  (x0,  arj)- 

Similarly,  if  xo  €  [go,  goo),  then  Xq  6  (poo,  Xo)  and  one  of  the 
following  must  be  true. 

4)  xj  £  (po,  go)  and  there  is  no  third  intersection  x2; 

5)  xl  £  [g0,  xQ); 

6)  xl  £  (poo,  po]  and  x§  £  (arj,  x0). 

Also,  if  xq  £  (pi,  p\)  [or  xo  £  (gj,  qj )],  then  xj,  Xq  and  the 
subsequent  intersections  will  all  be  in  the  interval  (p*,  p\)  [or 
(gj ,  qj)].  Furthermore,  for  any  xo  £  L\,  there  is  a  finite  fci  such 
that  ^2(^1 ,  #o)  €  (po,  go)-  After  that,  ^2( A: ,  xo)  will  have  no 
more  intersection  with  and  will  converge  to  the  origin. 

Proof:  Lemma  4.2  says  that  all  the  segments  [p*,  p\\ 
and  [gj-,  qj]  are  ordered  by  inclusion.  We  will  prove  the 
result  of  this  lemma  from  the  innermost  segment  to  the 
outermost  with  an  inductive  procedure.  Without  loss  of 
generality,  assume  that  [pi ,  pi]  is  the  innermost  segment 
(except  for  [po,  go]),  then  we  must  have  p\  £  (go,  gi]  and 
p\  =  sat2(An°Pi)  =  sat2(Am°pi). 

By  Lemma  4.3,  p2  £  (pi,  p\).  There  are  three  possibilities. 

Case  l—p\  £  [go,  pi)  :  (See  Fig.  3.)  Forx0  £  [go,  pi), 
Xq  =  sat2(An°xo)  by  Lemma  4.1  3).  Since  g^  =  sat2(An°go) 
and  p\  =  sat(An°pi)  are  to  the  left  of  go  and  pi  respectively, 
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For  s0  €  (pi,  p0],  xj  =  sat2(Am°s0)  €  [p£,  pf).  If  xj  €  by  the  argument  in  the  previous  paragraph,  we  must  have  xg  6 

(p0,  go),  then  we  get  1)  of  the  lemma.  If  xj  6  [go,  p\),  then  [g£,  xj)  C  (x0,  xj)  and  we  get  3)  of  the  lemma. 
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Fig.  7.  Illustration  for  the  proof  of  Lemma  4.4:  Case  i. 


Case  2— pj  G  (pi,  po]-  (See Fig. 4.) For x0  €  (pi,  Po], 
xj  =  sat2(Am°x0)  G  (pj,  Po]  •  Since  pf  and  po  are  to  the  right  of 
pi  andpo  respectively,  xj  must  also  be  to  the  right  of  xo,  i.e.,  Xq  G 
(x0,pj]-Ifxj  6  (2:0,  Po),  then  we  get  2)  and  the  subsequent  in- 
tersections,ifany,willmoverightwarduntilfallingbetweenpoand 
goiifxj  €  (p0,  Po)  C  (po,  g0),  then  we  get  1). 

For  x0  €  [go,  Pi),  *o  =  sat2(An°x0)  6  (p?,  go)-  If  4  € 
[P01  Qo)  c  (Po,  go)  then  we  obtain  4).  If  xj  G  {p\,  po],  then 
the  argument  in  the  foregoing  paragraph  applies  and  we  have 
4  e  (4>  Pol  C  (xo,  x0),  which  belongs  to  6). 

Case  3 — -pj  €  (po,  go)-'  (See  Fig.  5.)  For  x0  €  (pi,  Po], 
we  have  xj  G  {p\,  pj]  C  (po,  go),  which  belongs  to  1).  For 
xo  €  [go,  Pi),  we  have  xj  G  (pj,  go]  C  (po,  go),  which  be¬ 
longs  to  4). 

So  far,  we  have  shown  that  one  of  l)-6)  holds  for  all  xo  G 
[pi,  pj],  And  in  each  of  the  above  three  cases,  we  see  that  for 
all  xo  G  (pi,  pi),  Xo,  Xq  and  the  subsequent  intersections  are 
all  in  (pi ,  pi)  and  will  fall  between  p0  and  g0  in  a  finite  number 
of  steps. 

Next,  we  assume  that  these  properties  hold  for  all 
x0  G  [p»,  Pi]  and  the  next  segment  which  includes 
[Pi,  Pi]  is  [gj,  <lj]  (see  Fig.  6).  We  also  have  three  cases: 
q]  G  \pl ,  qj),  q]  €  (gj,  Pi]  and  qj  G  (pi,  pj)-  By  treating 

js  segment  [pi,  pj]  as  [po,  go]  in  the  proof  for  [pi,pj], 
We  can  use  the  same  argument  to  show  that  one  of  l)-6) 
holds  for  all  x0  G  (gj,  Pi]  U  \p\,  ,  qj).  Moreover,  for  all 
x0  6  (gj,  p»]  U  [pj, ,  g?),  the  intersections  will  move  toward 
[pi,  pj]  and  fall  between  [pi,  pj]  in  a  finite  number  of  steps. 


Now,  suppose  that  [p/,  pj]  is  the  outermost  segment.  By  in¬ 
duction,  we  have  obtained  the  properties  in  the  lemma  for  all 
x0  G  [p/,  pj]  and  we  would  like  to  extend  the  properties  to  the 
whole  line  Leh. 

Recall  that  mj  =  nj  -  1,  so  pj  =  Api  and 

p ]  =  sat 2(A2p/)  =  sat2(Apj).  The  line  AL\  will  actu¬ 
ally  intersect  with  ±L%  at  pj  and  -gj  (or  -pj  and  gj). 
Assume  that  pj  is  on  Lch.  Then  the  ray  {Ax:  x  G  [qj ,  goo)} 
is  below  the  line  -Leh.  Get  a  symmetric  projection  of 
this  ray  as  {-Ax:  x  G  [gj,  goo)}-  Then  the  two  rays 
{-Ax:  x  G  [qj,  goo)}  and  {Ax:  x  G  (poo,  P/]}  are  parallel 
and  are  both  above  the  line  L\  (see  Figs.  7  and  8).  Here,  we 
have  two  cases. 

Case  i:  The  rays  have  a  positive  slope  (see  Fig.  7).  Since 
pj  €  [gj,  goo),  we  have  pj  G  [gj,  goo)  and  by  Lemma  4.3, 
Pi  €  (pi,  pj).  So,  pj  G  (gj,  pj). 

For  x0  G  (pj,  goo),  since  both  gj  =  -sat2(Agj)  and  pj  = 
-sat2(Apj)  are  to  the  left  of  qj  and  pj,  respectively,  and  since 
there  exists  no  x  G  L%  such  that  — sat2(Ax)  =  x,  we  must 
have,  xj  =  -sat2(Ax0)  to  the  left  of  x0  and  xj  G  (pj,  x0). 
If  xj  G  (po,  go),  then  we  obtain  4).  If  xj  G  [go,  xo),  then  we 
obtain  5).  If  xj  G  (gj,  Po)  C  (gj,  qj),  then  by  the  established 
properties  on  [gj,  gj],  we  must  have  x§  G  (xj,  qj)  to  the  left 
of  pj  and  hence  to  the  left  of  x0.  Therefore,  x§  G  (x  j,  x0)  and 
we  get  6). 

For  x0  6  (poo,  Pi),  4  =  sat2(Ax)  is  to  the  right  of  pj,  so 
the  properties  for  xo  €  (p  j,  poo)  applies.  Also  note  that  x§  is  to 
the  right  of  pj.  Hence  x^  G  (x0,  xj)  and  we  obtain  3). 
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Fig.  9.  Illustration  for  the  proof  of  Lemma  4.5. 


W  Case  ii:  The  rays  have  a  negative  slope  (see  Fig.  8).  In  this 
case,  pj  €  (pz,  Qj). 

For  x0  C  (poo,  pj),  since  p\  =  Apx  is  to  the  right  of  pj  and 
there  exist  no  x  E  L%  such  that  sat2(Ar)  =  x ,  we  must  have 
x\  =  sat2(Ar0)  to  the  right  of  x0,  in  particular,  x0  e  (x0,  P/). 
If  Xq  €  (x0,  Po],  then  we  obtain  2).  If  Xo  €  (po>  go),  then  we 
have  1).  If  xj  €  ( go ,  Pj),  then  by  using  the  established  property 
in  the  interval  (p/,  p}),  we  have  x§  €  (pj,  xj)  C  (xo,  xj)  and 
we  obtain  3). 

For  x0  e  (p}>  goo),  x£  =  -sat2(Ax)  is  to  the  right  of  pj.  By 
applying  the  property  for  x0  in  (poo,  pj)  and  (pj,  p}),  we  have 
Xq  €  (xj,  xo),  which  belongs  to  f). 

Similar  to  the  argument  for  the  interval  (pi,  pi),  it  can  be 
shown  that  the  intersections  will  fall  between  (p/,  pj)  in  a  finite 
number  of  steps  for  all  xo  £  (p/,  p}). 

In  summary,  the  intersections  of  a  trajectory  V;2(k>  #o)  with 
the  lines  ±Leh  will  move  from  the  outer  intervals  to  the  inner 
intervals  until  falling  into  (p0,  g0)  in  a  finite  number  of  steps. 
After  that,  it  will  not  touch  the  lines  and  will  converge  to 
the  origin.  d 

Next,  we  suppose  that  the  condition  (9)  is  true  for  some  xi  € 
R.  We  would  like  to  determine  an  interval  in  Leh  such  that  a 
trajectory  starting  from  this  interval  will  converge  to  the  origin. 

Recall  that  pc  is  defined  to  be  the  unique  intersection  of  the 

yapunov  ellipsoid  £(pc)  with  the  line  Leh  (see  Fig.  9).  Also,  ac 
is  the  first  coordinate  ofpc,  i.e.,  pc  =  [®e]. 

Lemma  4.5:  Assume  that  ac  <  0.  If  there  exist  an  integer 
N  >  0  and  a  d  >  0  such  that  AN[X^  ]  =  ±[*+d]>  then  we  must 
have  Xi  <  ac  <  0. 


Proof:  When  ac  <  0,  an  ellipsoid  £ (p)  takes  the  shape  in 
Fig.  9.  Each  ellipsoid  £(p)  has  an  intersection  with  the  ray  that 
starts  from  the  origin  and  passes  through  pc.  This  intersection  is 
the  highest  point  in  the  ellipsoid.  Since  ac  <  0,  it  can  be  seen 
that 


<  V  =fc 


Xi  1\ 

l+d\ ) 


Vxi  >  ac,  d  >  0. 


(ri?D<v([?D 


it  is  impossible  to  have  Aiv[x11  ]  =  for  any  x\  >  ac.  □ 

Lemma  4.6:  Let 

a3  =  min  {|xi|:  xi  satisfies  (9)} . 

Case  1)  ac  <  0.  Let 


then  pi  =  pa  e  (pco,  Po)-  Suppose  that  p9  e 
[pi+ 1,  pi).  Then,  for  every  x0  €  (pa,  p*],  the  tra¬ 
jectory  xo)  will  converge  to  the  origin; 

Case  2)  ac  >  0.  Let 


then  pi  =  p3  e  (go,  goo).  Suppose  that  p3  e 
fe,  gj+i]-  Then,  for  every  x0  e  [gj,  ps],  the  tra¬ 
jectory  xo)  will  converge  to  the  origin. 
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In  both  cases,  no  limit  trajectory  can  be  formed  completely  If  this  is  true,  then  x\,  the  first  coordinate  of  xo,  can  be  solved 
inside  the  strip  fr°m 


{[£];W<°'}- 

Proof:  We  only  prove  Case  1.  Since  ac  <  0,  by  Lemma 
4.5,  there  is  no  xi  >  ac  satisfying  (9),  so  we  have  -a,  < 
ac  <  0  and  p„  must  be  between  p»+i  and  Pi  for  some  i,  noting 
that  ps  cannot  be  in  [po,  ?o]  by  Lemma  4.1  1).  Following  the 
iterative  procedure  in  the  proof  of  Lemma  4.4,  we  can  show 
that  for  all  x0  G  [p,,  pj],  the  trajectory  will  converge  to  the 
origin.  Now  we  consider  a  point  between  p8  and  pi.  For  xq  in 
this  interval,  the  next  intersection  of  the  trajectory  with  the  lines 
±Leh  is  x£  =  sat2(Amix0).  Since  sat2(Am'ps)  =  ps  (or  -p9) 
and  p\  =  sat2(Am,pi)  is  to  the  right  of  pi,  we  must  have  xj  G 
(xo,  pj),  and  the  subsequent  intersections  will  move  rightward 
and  fall  between  pi  and  pi  in  a  finite  number  of  steps.  Therefore, 
the  trajectory  ^{k,  xo)  will  converge  to  the  origin. 

Now,  consider  x0  G  (pj,  tfoo)  C  (pc,  <?<»)•  Let  ki  be  the 
minimal  integer  such  that  Afclx0  goes  out  of  Se,  then  by  the 
shape  of  the  Lyapunov  ellipsoid,  the  point  Afclxo  must  be  to 
the  left  of  x0  (or  to  the  right  of  -x0  if  A*x0  is  below  the  line 
—LI),  otherwise  we  would  have  V(Aklxo)  >  V{xf),  which 
is  impossible.  Hence,  Xq  =  sat2(Afc,xo)  must  be  to  the  left  of 
xo,  and  the  subsequent  intersections  either  fall  between  ps  and 
pi  at  a  finite  step,  or  go  to  the  left  of  pa.  This  shows  that  no 
limit  trajectory  can  be  formed  completely  to  the  right  of  ps  and 
^nmetrically,  to  the  left  of-p*.  Hence,  no  limit  trajectory  can 
'tie  formed  completely  inside  the  strip 

□ 


[1 


=  ±Xl- 


(14) 


In  summary,  we  have  the  following 

Algorithm  for  Determining  All  the  Xi  Satisfying  Condition 
(9):  Assume  ac  <  0.  Initially  set  i  =  0. 

Step  1)  i  =  i  + 1.  If  (13)  is  satisfied,  then  compute  xx  from 
(14).  Repeat  this  step  until  i  =  I  -  1. 

Step  2)  Solve 


[1  0]A 


Xi 

1 


=  ±X1 


forxi,  ifxi  G  ( — oo,  a/),  thenxx  satisfies  (9)  with 
N  =  1. 


V.  Proof  of  the  Main  Results 

Now,  we  turn  back  to  the  system  (5), 

x(k  +  1)  =  sat(Ax(fc)).  (15) 

For  easy  reference,  we  restate  Theorem  2.1  as  follows. 

Theorem  5.1:  The  system  (15)  is  globally  asymptotically 
stable  if  and  only  if  A  is  stable  and  none  of  the  following 
statements  are  true. 

1)  There  exists  an  N  >  1  such  that 

sat(AJv^i))  =  ixi  and  Akv i  G  S  V  k  <  N. 

2)  There  exists  an  N  >  1  such  that 

sat(AiVv2))  =  ±v2  and  Afcv2  G  S  V  k  <  N. 

3)  There  exists  an  xi  G  (-1,  1)  and  an  N  >  1  such  that 


Proof  of  Proposition  4.1:  It  follows  immediately  from 
Lemmas  4.4  and  4.6.  CD 

The  number  a3  and  the  point  ps  =  [*“']  can  be  easily  com¬ 
puted  by  applying  Lemma  4. 1 .  Actually,  all  the  x i  satisfying  (9) 
can  be  determined.  Let  xo  =  [*x  ],  then  xi  satisfies  (9)  for  some 
N  if  and  only  if  xo  satisfies 

Anx 0$Se  Akxo  G  S*  V  k  <  N 


and 


sat2(AJvxo)  =  Xq.  (12) 

Assume  that  ac  <  0,  then  by  Lemma  4.5,  we  only  need  to  check 
if  there  is  such  an  xo  in  the  interval  (p0 0,  Po)-  Clearly,  no  xo  in 
[p0,  qo)  satisfies  (12)  by  Lemma  4.1  1).  So  we  need  to  check 
over  the  intervals  [pi+i,  Pi)  with  i  increased  from  0  to  I  -  1 
and  the  interval  (poo,  Pi)- 

Consider  a  point  xo  in  the  interval  [pi+i,  Pi).  By  Lemma  4.1 
2),  the  smallest  integer  N  for  AArx0  ^  Se  is  N  =  rrii.  By 
imma  4.2  3),  Amipi  =  p\  G  (<zo,  loo)  is  to  the  right  of  pi; 
So  there  exists  xo  G  [p,+i,  Pi)  satisfying  (12)  if  and  only  if 
Am,pi+i  is  to  the  left  of  p»+i,  i.e., 

Sat 2 (A  'px_(-i)  G  (Pooi  Pi-f-l]*  (13) 


4)  There  exists  an  x2  G  (-1,  1)  and  an  N  >  1  such  that 


vk<N ■ 

Proof:  We  will  exclude  the  possibility  of  the  existence  of 
limit  trajectories  (except  for  the  trivial  one  at  the  origin)  under 
the  condition  that  none  of  statements  1>— 4)  in  the  theorem  is 
true.  In  the  following,  when  we  say  a  limit  trajectory,  we  mean 
a  nontrivial  one  other  than  the  origin.  Clearly,  every  limit  trajec¬ 
tory  must  include  at  least  one  point  on  the  boundary  of  the  unit 
square,  i.e.,  a  point  in  the  set  ±(IA  U  Lv  U  {to ,  u2}) .  By  Propo¬ 
sition  3.1,  we  know  that  a  limit  trajectory  cannot  have  points 
in  both  ±Lh  and  ±LV.  So  we  have  two  possibilities  here,  limit 
trajectories  including  points  in  ±(L;,  U  {vi,  v2}),  and  those  in¬ 
cluding  points  in  ±(A,  U  {t>i ,  to  } )  •  Because  of  the  similarity, 
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we  only  exclude  the  first  possibility  under  the  condition  that 
none  of  l)-3)  is  true,  the  second  possibility  can  be  excluded 
ider  the  condition  that  none  of  1),  2)  and  4)  is  true. 

For  a  given  initial  state  x0 ,  we  denote  the  trajectory  of  the 
system  (15)  as  V'( k ,  ^o)  and  the  trajectory  of  (7)  as  x0). 

Clearly,  if  x\  G  (— 1,  1)  satisfies  3),  then  this  xi  also  satis¬ 
fies  (9).  On  the  other  hand,  suppose  that  there  is  some  xi  that 
satisfies  (9).  Let  p3  be  as  defined  in  Lemma  4.6  for  the  system 
(7)  [if  there  is  no  xx  that  satisfies  (9),  then  we  can  assume  that 


and  the  following  argument  also  goes  through].  Note  that,  if 
there  is  some  xx  €  R,  \x±\  <  1,  that  satisfies  (9),  i.e., 


*N  Si  _ 

L 1  - 


and 


[0  1  ]Ah 
we  must  also  have 

|[1  0]A* 


Xx 

1 


Xx 

1 


*1 

1  +  d 


<1  VfcciV 


<\xx\  V  k  <  N 


which  indicates  that  xi  satisfies  3).  Otherwise,  as  in  the  proof 
of  Proposition  3.1,  the  area  of  the  convex  hull  of  the  set 


{±#0,  ±A#o*  •  • . ,  ± AN  ^o} 

"would  be  less  than  the  area  of  the  convex  hull  of  the  set 


So,  we  have  ^2(k>  ^2)  —  v 2 )  for  all  k  <  ko.  Here,  we 

have  two  cases. 

Case  1 — ac  <  0:  In  this  case,  p9  is  to  the  left  of  tj2.  Since 
v\  =  sat(Afc°t;2)  =  sat2(AA:o7/2)  goes  to  the  right  of  v2,  by 
Lemma  4.5,  v2  must  be  to  the  left  of  po-  It  follows  that  t/2  e 
{Psi  PiL  where  (p3,  p\\  is  the  interval  in  Lemma  4.6  2).  Hence, 
(fc,  V2)  will  converge  to  the  origin.  Moreover,  the  subsequent 
intersections  of  ^2)  with  ±Lh  are  between  vz  and  v\. 
Since  k ,  vz)  does  not  touch  ±LV>  we  must  have  ip(k,  v2 )  = 
v2)  and  hence  k ,  v2)  will  also  converge  to  the  origin. 

Case  2—ac  >  0;  In  this  case  p3  is  to  the  right  of  74.  By 
the  assumption  that  7/>(fc,  74)  does  not  include  74,  the  intersec¬ 
tions  of  ^2  (fc,  ^2)  with  ±Lh  will  stay  to  the  left  of  vx  (or  to  the 
right  of  —vx).  Since  ac  >  0,  by  Lemma  4.5,  the  intersections 
will  move  rightward  until  falling  on  [<?},  p3),  where  [qj,  ps)  is 
the  interval  in  Lemma  4.6  3).  Similar  to  Case  1,  we  have  that 
^>2(fc,  V2 )  converges  to  the  origin  and  ^(k,  v2)  =  ^2(fc,  74), 
So  far,  we  have  excluded  the  possibility  that  a  limit  trajec¬ 
tory  includes  any  point  in  the  set  db(Lft  U  {74,  74}).  The  possi¬ 
bility  that  a  limit  trajectory  includes  any  point  in  the  set  ±(LV  U 
{74,  t/2})  can  be  excluded  in  a  similar  way.  Thus,  there  exists 
no  limit  trajectory  of  any  kind  and  the  system  ( 1 5)  must  be  glob¬ 
ally  asymptotically  stable.  □ 

Here  we  provide  a  simple  method  to  check  the  conditions  3) 
and  4)  of  Theorem  5.1  based  on  the  algorithm  to  determine  all 
the  xx  satisfying  (9)  and  hence  ps  in  the  previous  section.  From 
the  proof  of  Theorem  5.1,  we  see  that  3)  is  true  if  and  only  if 
ps  e  S.  To  check 4),  we  can  exchange  x\  and  x2,  i.e.,  use  a  state 
transformation  y  =  [J  q]#.  The  system  (15)  is  then  equivalent 
to 


{±Ax 0,  ±A2x 0,  . . . ,  iA^aro}. 

This  would  be  a  contradiction  to  the  fact  that  |  det(A)|  <  1. 

Hence,  if  no  24  satisfies  3),  then  p9  must  be  outside  of  S. 
By  Proposition  4.1,  no  limit  trajectory  of  (7)  can  lie  completely 
inside  the  strip 


y(k  +  1)  =  sat  (Ay{k))  (16) 

where  A  =  J]A[ °  J].  The  condition  4)  for  the  system  (15)  is 
equivalent  to  the  condition  3)  for  the  system  (16). 

VI.  Conclusions 


It  follows  that  no  limit  trajectory  of  (15)  can  lie  completely  be¬ 
tween  — Lv  and  Lv.  Therefore,  no  limit  trajectory  of  (15)  can  in¬ 
clude  only  boundary  points  in  ± Lh .  On  the  other  hand,  if  a  limit 
trajectory  include  only  boundary  points  ±74  (or  ±7*2,  note  that, 
by  Proposition  3 . 1 ,  no  limit  traj  ectory  can  include  both  ±74  and 
±t;2),  then  1)  or  2)  must  be  true,  which  contradicts  our  assump¬ 
tion.  In  short,  if  there  is  a  limit  trajectory  that  include  points  in 
±(LfcU{74,  v2}),  it  must  include  at  least  one  point  on  ±Lh  and 
one  on  ±74  (or  ±v2).  Here,  we  assume  that  it  includes  v2. 

Let  us  consider  the  trajectories  1 p(k,  v2)  and  ^2 (fc,  ^2)*  Sup¬ 
pose  that  ip(ki  v2)  has  an  intersection  with  ±Lh  but  does  not 
include  74  and  any  point  in  ±LV,  we  conclude  that  v2)  = 
'tpzik,  v2)  will  converge  to  the  origin.  The  argument  goes  as  fol¬ 
lows. 

Let  fco  be  the  smallest  k  such  that  ij)( k ,  74)  intersects  ±Lh. 
Denote  v\  =  ^(fco,  t>2).  Since  2)  is  not  true,  fco  must  also  be  the 
smallest  fc  such  that 


|[0  l}Akv2\>l- 


We  gave  a  complete  stability  analysis  of  a  planar  dis¬ 
crete-time  linear  system  under  saturation.  The  analysis  involves 
intricate  investigation  on  the  intersections  of  the  trajectories 
with  the  lines  xx  =  ±1  and  x2  =  ±1.  Our  main  result  provides 
a  necessary  and  sufficient  condition  for  such  a  system  to  be 
globally  asymptotically  stable. 
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Stabilization  of  Exponentially  Unstable  Linear  Systems 
with  Saturating  Actuators 


} 


Tingshu  Hu,  Zongli  Lin,  and  Li  Qiu 


Abstract — We  study  the  problem  of  stabilizing  exponentially  unstable 
linear  systems  with  saturating  actuators.  The  study  begins  with  planar  sys¬ 
tems  with  both  poles  exponentially  unstable.  For  such  a  system,  we  show 
that  the  boundary  of  the  domain  of  attraction  under  a  saturated  stabi¬ 
lizing  linear  state  feedback  is  the  unique  stable  limit  cycle  of  its  time-re- 
versed  system.  A  saturated  linear  state  feedback  is  designed  that  results  in 
a  closed-loop  system  having  a  domain  of  attraction  that  is  arbitrarily  close 
to  the  null  controllable  region.  This  design  is  then  utilized  to  construct  state 
feedback  laws  for  higher  order  systems  with  two  exponentially  unstable 
poles. 

Index  Terms— Actuator  saturation,  domain  of  attraction,  null  control¬ 
lable  region,  semiglobal  stabilization. 


I.  Introduction 

We  consider  the  problem  of  stabilizing  exponentially  unstable  linear 
systems  subject  to  actuator  saturation.  For  systems  that  are  not  expo¬ 
nentially  unstable,  this  stabilization  problem  has  been  focus  of  study 
and  is  now  well  addressed.  For  example,  it  was  shown  in  [13]  that 
a  linear  system  subject  to  actuator  saturation  can  be  globally  asymp¬ 
totically  stabilized  by  nonlinear  feedback  if  and  only  if  the  system 
is  asymptotically  null  controllable  with  bounded  controls  (ANCBC), 
which,  as  shown  in  [11],  is  equivalent  to  the  system  being  stabiliz- 
able  in  the  usual  linear  sense  and  having  open-loop  poles  in  the  closed 
left-half  plane.  A  nested  feedback  design  technique  for  designing  non- 

tear  globally  asymptotically  stabilizing  feedback  laws  was  proposed 
[16]  for  a  chain  of  integrators  and  was  fully  generalized  in  [14]. 
Alternative  solutions  to  the  global  stabilization  problem  consisting  of 
scheduling  a  parameter  in  an  algebraic  Riccati  equation  according  to 
the  size  of  the  state  vector  was  later  proposed  in  [  1 2],  [  1 7] .  The  question 
of  whether  or  not  a  general  linear  ANCBC  system  subject  to  actuator 
saturation  can  be  globally  asymptotically  stabilized  by  linear  feedback 
was  answered  in  [3],  [1 5],  where  it  was  shown  that  a  chain  of  integrators 
of  length  greater  than  two  cannot  be  globally  asymptotically  stabilized 
by  saturated  linear  feedback. 

The  notion  of  semiglobal  asymptotic  stabilization  on  the  null  con¬ 
trollable  region  for  linear  systems  subject  to  actuator  saturation  was 
introduced  in  [7],  [8].  The  semi-global  framework  for  stabilization  re¬ 
quires  feedback  laws  that  yield  a  closed-loop  system  which  has  an 
asymptotically  stable  equilibrium  whose  domain  of  attraction  includes 
an  a  priori  given  (arbitrarily  large)  bounded  subset  of  the  null  control¬ 
lable  region.  In  [7],  [8],  it  was  shown  that,  for  linear  ANCBC  systems 
subject  to  actuator  saturation,  one  can  achieve  semi-global  asymptotic 
stabilization  on  the  asymptotically  null  controllable  region  (the  whole 
state  space  in  this  case)  using  linear  feedback  laws. 
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Despite  the  existing  results  (see  [2]  for  an  extensive  chronological  . 
bibliography  on  the  subject),  the  general  picture  of  stabilizing  expo¬ 
nentially  unstable  linear  systems  with  saturating  actuators  remains  not 
as  clear  as  that  of  ANCBC  systems.  It  is  clear  that  this  kind  of  systems 
cannot  be  globally  stabilized  in  any  way  since  they  are  not  globally 
null  controllable.  The  largest  possible  region  on  which  a  system  can  be 
stabilized  is  the  null  controllable  region.  In  [4],  we  gave  an  explicit  de¬ 
scription  of  the  null  controllable  region  for  a  general  linear  system  in 
terms  of  a  set  of  extremal  trajectories  of  the  (time  reversed)  antistable 
subsystem.  We  recall  that  a  linear  system  is  said  to  be  antistable  if  all  its 
poles  are  in  the  open  right-half  plane  and  semistable  if  all  its  poles  are 
in  the  closed  left-half  plane.  For  example,  for  a  second  order  antistable 
system,  the  boundary  of  its  null  controllable  region  is  covered  by  at 
most  two  extremal  trajectories;  and  for  a  third  order  antistable  system, 
the  set  of  extremal  trajectories  can  be  described  in  terms  of  parameters 
in  a  real  interval. 

Based  on  the  description  of  the  null  controllable  region  in  [4],  we 
begin  our  study  of  stabilization  with  planar  antistable  systems.  We 
show  that  for  such  a  system  the  boundary  of  the  domain  of  attraction 
under  any  stabilizing  saturated  linear  state  feedback  is  the  unique  stable 
limit  cycle  of  its  time-reversed  system.  Moreover,  the  domain  of  attrac¬ 
tion  is  convex.  We  next  show  that  any  second  order  antistable  linear 
system  can  be  semiglobally  asymptotically  stabilized  on  its  null  con¬ 
trollable  region  by  saturated  linear  feedback.  That  is,  for  any  a  priori 
given  set  in  the  interior  of  the  null  controllable  region,  there  exists  a 
saturated  linear  feedback  law  that  yields  a  closed-loop  system  which 
has  an  asymptotically  stable  equilibrium  whose  domain  of  attraction 
includes  this  given  set.  This  design  is  then  utilized  to  construct  state 
feedback  laws  for  higher  order  systems  with  two  exponentially  unstable 
poles. 

The  remainder  of  this  note  is  organized  as  follows.  Section  II  con¬ 
tains  a  brief  summary  of  the  description  of  the  null  controllable  region 
which  will  be  used  in  this  note.  Section  III  determines  the  domain  of 
attraction  for  a  second  order  antistable  linear  system  under  any  satu¬ 
rated  stabilizing  linear  feedback  law.  Section  IV  constructs  saturated 
feedback  laws  that  achieve  semiglobal  asymptotic  stability  on  the  null 
controllable  region  for  any  linear  systems  having  two  exponentially  un¬ 
stable  poles.  Finally,  Section  V  draws  some  brief  conclusions. 

II.  Results  on  the  Null  Controllable  Region 

Consider  a  linear  system 

x(t)  =  Ax{t)  +  bu(t),  \u\<l  (1) 

where  x(t)  £  Rn  is  the  state  and  u(t)  £  R  is  the  control.  Assume 
that  (A,  b)  is  stabilizable.  The  null  controllable  region  of  the  system, 
denoted  as  C,  is  defined  to  be  the  set  of  states  that  can  be  steered  to 
the  origin  in  a  finite  time  by  using  a  control  u  that  is  measurable  and 
(u(t)|  <  1  for  all  t.  If  A  is  antistable,  then  C  is  a  bounded  convex 
open  set.  For  a  general  unstable  system,  C  is  the  Cartesian  product  of 
the  null  controllable  region  of  its  semistable  subsystem,  which  is  the 
whole  subspace,  and  that  of  its  antistable  subsystem.  It  was  shown  in 
[4]  that  dC  (the  boundary  of  C)  of  an  anti-stable  system  is  composed 
of  a  set  of  extremal  trajectories  of  its  time  reversed  system.  The  time 
reversed  system  of  (1)  is 

z(t)  =  -Az(t)  — bv(t ),  |t»|  <  1.  (2) 

Suppose  that  A  is  anti-stable,  denote 

£  :=  {i>(t)  =  sga(c'eAtb),  t  €  R:  c  ^  0}  (3) 
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and  for  a  control  u,  |u(t)|  <  1  for  all  t  E  R,  denote  the  trajectory  of 
(2)  under  the  control  of  v  as 


i,  v)  :=  f  e  rhv(r)dr. 
J  — oo 


Since  A  is  antistable,  the  integral  in  (4)  exists  for  all  t  E  H,  so  #(£,  a) 
is  well  defined.  It  is  shown  in  [4]  that 

dC  =  v):t£  R,  u  E  £}.  (5) 

In  particular,  for  a  second-order  antistable  system,  if  A  has  two  real 
eigenvalues,  then 

dC  —  ~  J  e~A^t~’r^  drj  :  t  E  [0,  oo] 

=  {±(-2e~At  +  I)A^b:  t  E  [0,  oo]}  (6) 

where  z~  —  A”1 6  is  the  equilibrium  point  under  the  constant  control 
u  =  —1;  if  A  has  a  pair  of  complex  eigenvalues  a  ±  a,  f3  >  0, 
then 

8C  =  |±  \e~Mz:  -.jf  e~A<-l~T'lb  <fr]  :  t  €  [0,  Tp]j 
=  {±Ie“"*r  ~  (/  “  t  €  [0,  Tp}}  (7) 

where  Tp  =  tt//5  and  2:7  =  (J  4-  e“AT’’)“1  (J  - 

III.  Domain  of  Attraction  Under  Saturated  linear  State 
Feedback 

Jr  Also  consider  the  open-loop  system  (1).  A  saturated  linear  state  feed¬ 
back  is  given  by  u  =  <r(/x),  where  /  E  R1Xn  is  the  feedback  gain 
and  <?(•)  is  the  saturation  function  a(s)  =  sgn(s)  min{l,  |s|}.  Such 
a  feedback  is  said  to  be  stabilizing  if  A  +  bf  is  asymptotically  stable. 
With  a  saturated  linear  state  feedback  applied,  the  closed-loop  system 


x(t)  =  Ax(t)  -b  b<r(fx(t)).  (8) 

Denote  the  state  transition  map  of  (8)  by  <j>:  (f,  x0)  »->•  x(t).  The  do¬ 
main  of  attraction  S  of  the  equilibrium  x  =  0  of  (8)  is  defined  by 

S  :=  jx0  E  R”:  hm  <£(t,  x0)  =  oj . 

Obviously,  S  must  lie  within  the  null  controllable  region  C  of  the 
system  (1).  Therefore,  a  design  problem  is  to  choose  a  state  feedback 
gain  so  that  S  is  arbitrarily  close  to  C .  We  refer  to  this  problem  as 
semiglobal  stabilization  on  the  null  controllable  region.  We  will  first 
deal  with  antistable  planar  systems,  then  extend  the  results  to  higher 
order  systems  with  only  two  antistable  modes. 

For  the  system  (8),  assume  that  A  6  R2x2  is  anti-stable.  In  [1],  it 
was  shown  that  the  boundary  of  5,  denoted  by  dS,  is  a  closed  orbit,  but 
no  method  to  find  this  closed  orbit  is  provided.  Generally,  only  a  subset 
of  S  lying  between  fx  =  1  and  fx  =  —  1  is  detected  as  a  level  set  of 
some  Lyapunov  function  (see,  e.g.,  [5]).  Let  P  be  a  positive-definite 
matrix  such  that  (A  +  &/)'  P  +  P(A  +  bf)  is  negative-definite.  Since 
{z  E  R2:  —  1  <  fz  <  1}  is  an  open  neighborhobd  of  the  origin,  it 
must  contain 
) 

Go  :=  {z  €  R2:  z' Pz  <  r0}  (9) 

for  some  r0  >  0.  Clearly,  Qo  is  an  invariant  set  inside  S.  However,  Qo 
as  an  estimation  of  the  domain  of  attraction  can  be  very  conservative 
(see,  e.g..  Fig.  1). 


■al  i. — —  i  —i - 1 - 1  - -i - 1 - 1  ,  ...i - j 

mO  *ft«6*4»2  024$8  10 

Fig.  1 .  Determination  of  dS  from  the  limit  cycle. 

Lemma  3.1  [1]:  The  origin  is  the  unique  equilibrium  point  of 
system  (8). 

Let  us  introduce  the  time-reversed  system  of  (8) 

z(t)  =  -Az(t)  -  ba(fz(t)).  (10) 

Clearly  (10)  also  has  only  one  equilibrium  point,  an  unstable  one,  at  the 
origin.  Denote  the  state  transition  map  of  (10)  by  in  (t}  zf)  z(t ). 

Theorem  3.1 :  dS  is  the  unique  limit  cycle  of  planar  systems  (8) 
and  (10).  Furthermore,  dS  is  the  positive  limit  set  of  z0)  for  all 

Zq  ^  0. 

This  theorem  says  that  dS  is  the  unique  limit  cycle  of  (8)  and  (10). 
This  limit  cycle  is  a  stable  one  for  (10)  (in  a  global  sense),  but  an  un¬ 
stable  one  for  (8).  Therefore,  it  is  easy  to  determine  dS  by  simulating 
the  time-reversed  system  ( 1 0).  Shown  in  Fig.  1  is  a  typical  result,  where 
two  trajectories,  one  starting  from  outside,  the  solid  curve,  and  the  other 
starting  from  inside,  the  dashed  curve,  both  converge  to  the  unique  limit 
cycle.  The  straight  lines  in  Fig.  1  are  fz  =  1  and  fz  =  —  1. 

To  prove  Theorem  3.1,  we  need  the  following  two  lemmas,  proofs 
of  which  can  be  found  in  [4]. 

Lemma  3.2;  Suppose  that  A  E  R2x2  is  anti-stable  and  (/,  A)  is 
observable.  Given  a  c  >  0,  let  xi,  x2,  y\  and  y2  (zi  ^  be  four 
points  on  the  line  fx  =  c,  satisfying 


y\  =  eATlxi, 


for  some  T\ ,  T2  >0  and 


2/2  =  eAT2x2, 


/eA<1xi  >  c  feAt2x2  >  c,  Vti  E  (0,  Ti),  t2  E  (0,  T2) 
then,  ||yi  -  y2\\  >  ||*i  -  x2||. 

Shown  in  Fig.  2  is  an  illustration  of  Lemma  3.2.  The  curve  from 
Xi  to  yi  is  x(t)  =  eAtXt,  t  E  [0,  Ti],  a  segment  of  a  trajectory  of 
the  autonomous  system  x  =  Ax.  Lemma  3.2  indicates  that  if  any  two 
different  trajectories  leave  a  straight  line  on  the  same  side,  they  will  be 
further  apart  when  they  return  to  it. 

Lemma  3.3:  Suppose  that  A  E  R2*2  is  asymptotically  stable  and 
(/,  A)  is  observable.  Given  a  c  >  0,  let  xi,  x2  be  two  points  on  the 
line  fx  =  c  and  yi,  Vi  be  two  points  on  fx  —  —  c  such  that 


2/i  =  eATlxi, 


2/2  =  eAT*x2 


for  some  Ti ,  T2  >  0,  and 


\feMxx\\  <  c,  lfeAt2x2l  <  c, 

Vii  6  (0,  Ti),  t2  e  (0,  T2) 


then,  ||yi  —  y2||  >  ||a:i  -  x2||. 
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Fig.  2.  Illustration  of  Lemma  3.2. 


Fig.  3 .  Illustration  of  Lemma  3 .3 . 


Shown  in  Fig.  3  is  an  illustration  of  Lemma  3.3.  It  says  that  if  two 
different  trajectories  of  the  autonomous  system  x  —  Ax  enter  the  re¬ 
gion  between  fx  =  c  and  fx  =  -c,  they  will  be  further  apart  when 
they  leave  the  region.  Notice  that  in  Lemma  3.2,  A  is  antistable,  and  in 
Lemma  3.3,  A  is  asymptotically  stable. 

Proof  of  Theorem  3.1:  We  first  prove  that  for  the  system  (10), 
every  trajectory  z0 ),  z0  #  0,  converges  to  a  periodic  orbit  as 
t  -4  oo.  Recall  that  Q0  [defined  in  (9)]  lies  within  the  domain  of 
attraction  of  the  equilibrium  x  =  0  of  (8)  and  is  an  invariant  set.  It 

fllows  that,  for.  every  state  zo  f  0  of  (10),  there  is  some  to  >  0  such 
at  ^(t,  zo)  lies  outside  Qo  for  all  t  >  to.  The  state  transition  map  of 
the  system  (10)  is 


-0(t,  zo)  =  e  Atz0 


-A(i-r) 


b<r(fz(r))  dr. 


Since  -A  is  stable,  the  first  term  converges  to  the  origin.  Since 
\<r(fz(r))\  <  1,  the  second  term  belongs  to  C,  the  null  controllable 
region  of  (1),  for  all  t.  It  follows  that  there  exists  an  n  >  r0 
such  that  ipr(t7  zo)jP2K^>  zo)  <  t\  <  oo  for  all  t  >  to.  Let 
Q  =  {z  6  R2:  r0  <  z'Pz  <  T\}.  Then  z0),  t  >  t0,  lies 
entirely  in  Q.  It  follows  from  the  Poincare-Bendixon  theorem  that 
ip(t,  zo)  converges  to  a  periodic  orbit. 

The  preceding  paragraph  shows  that  (8)  and  (10)  have  periodic  or¬ 
bits.  We  claim  that  the  system  (8)  and  (10)  each  has  only  one  periodic 
orbit.  For  direct  use  of  Lemma  3.2  and  Lemma  3.3,  we  prove  this  claim 
through  the  original  system  (8). 

First  notice  that  a  periodic  orbit  must  enclose  the  unique  equilibrium 
point  x  =  0  by  the  index  theory,  see  e.g.,  [6],  and  must  be  symmetric 
to  the  origin  (— T  is  a  periodic  orbit  if  T  is,  hence  if  the  periodic  orbit 
is  not  symmetric,  there  will  be  two  intersecting  trajectories).  Also,  it 
cannot  be  completely  contained  in  the  linear  region  between  fx  = 
1  and  fx  =  -1.  (Otherwise  the  asymptotically  stable  linear  system 
X  SB  (A  4  bf)x  would  have  a  closed  trajectory  in  this  region.  This  is 
impossible).  Hence,  it  has  to  intersect  each  of  the  lines  fx  =  ±1  at 
least  twice.  Assume  without  loss  of  generality  that  (/,  A,  b )  is  in  the 
observer  canonical  form,  i.e.,  /  =  [0  1],  A  =  [J  b  =  [&*]> 

jith  ai,  a2  >  0,  and  denote  *  =  [^].  In  this  case,  fx  =  ±1  are 
horizontal  lines.  The  stability  of  A  4  b  f  requires  that  -oi  4  &i  <  0 
and  a2  4  &2  <  0.  Observe  that  on  the  line  fx  -  1,  we  have  =  1 
and  $2  =  fi  4  4  62.  Hence,  if  fi  >  -a2  -  62,  then  &  >  0,  i.e., 

the  trajectories  go  upwards;  if  ^1  <  -02—62,  then  £2  <  0,  i.e.,  the 
trajectories  go  downwards.  This  implies  that  any  periodic  orbit  crosses 


Fig.  4.  Illustration  for  the  proof  of  Theorem  3.1. 

fx  =  1  exactly  twice  and  similarly  for  fx  =  -1.  It  also  implies  that 
a  periodic  orbit  goes  counter-clockwise. 

Now,  suppose  on  the  contrary  that  (8)  has  two  different  periodic  or¬ 
bits  Ti  and  r2,  with  enclosed  by  T2,  as  illustrated  in  Fig.  4.  Note 
that  any  periodic  orbit  must  enclose  the  origin  and  any  two  trajectories 
cannot  intersect.  Hence,  all  the  periodic  orbits  must  be  ordered  by  en- 
closement.  Let  x\  and  yi  be  the  two  intersections  of  Ti  with  fx  =  1, 
and  x2 ,  y2  be  the  two  intersections  of  T2  with  fx  —  1.  Then,  along  T 1 , 
the  trajectory  goes  from  x\  to  y\ ,  —  xi,  —  yi  and  returns  to  x\ ;  along 
r2,  the  trajectory  goes  from  x2  to  y2,  -z2,  -2/2  and  returns  to  x2 . 

Letx^  =  —A-1  b.  Since  xi  — ►  yi  along  Ti  and  x2  — >  2/2  along  T2 
are  on  trajectories  of  x  =  Ax  4  6  (or  d(x  —  x t)/dt  —  A(x  —  xf )), 
we  have 

VI  -  xt  =  eATl(xi  -  xi)  y2  -  =  eAT2(x2  -  xt) 

for  some  Tu  T2  >  0.  Furthermore,  f(x ,  -  xt)  =  f(x2  -  xf)  = 
f(y i -xi)  =  f(y2-xi)  =  l-fxi  >  0 (since / xi  =  bi/ai  <  1) 
and  for  all  x  on  the  two  pieces  of  trajectories,  f{x  -  xi)  >  1  -  fxi . 
It  follows  from  Lemma  3.2  that 

IIS/2  -  3/1 II  >  11*2  -  *l||- 

On  the  other  hand,  yi  — *■  —xi  along  T i  and  y2  — *  — *2  along  T2  are 
on  trajectories  of  x  =  (A  +  bf)x  satisfying  -xx  =  e{A+bf  )Tiyi  and 
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— X2  =  e(A+b/)T4^2  for  some  7^  y4  >  o.  It  follows  from  Lemma 
3.3  that 

11*2 -®i  II  >  ||y2  -yi|| 

which  is  a  contradiction.  Therefore,  T i  and  T2  must  be  the  same  pe¬ 
riodic  orbit.  This  shows  that  the  systems  have  only  one  periodic  orbit 
and,  hence,  it  is  a  limit  cycle. 

We  have  so  far  proven  that  both  (8)  and  (10)  have  a  unique  limit 
cycle  and  every  trajectory  ^(t,  zo),  zo  #  0,  of  (10)  converges  to  this 
limit  cycle.  This  implies  that  a  trajectory  0(t,  xq)  of  (8)  converges  to 
the  origin  if  and  only  if  xo  is  inside  the  limit  cycle.  This  shows  that  the 
limit  cycle  is  dS.  D 

In  the  above  proof,  we  also  showed  that  dS  is  symmetric  and  has 
two  intersections  with  fx  =  1  and  two  with  fx  =  -1.  Another  nice 
feature  of  5,  as  shown  in  [4],  is  that  it  is  convex. 


IV.  Semiglobal  Stabilization  on  the  Null  Controllable 
Region 


A.  Second  Order  Antistable  Systems 

In  this  subsection,  we  continue  to  assume  that  A  E  R2x2  is  an¬ 
tistable  and  ( A ,  b )  is  controllable.  We  will  show  that  the  domain  of 
attraction  S  of  the  equilibrium  x  =  0  of  the  closed-loop  system  (8) 
can  be  made  arbitrarily  close  to  the  null  controllable  region  C  by  judi¬ 
ciously  choosing  the  feedback  gain  /.  To  state  the  main  result  of  this 
section,  we  need  to  introduce  the  HausdorfF  distance.  Let  X\ ,  X2  be 
two  bounded  subsets  of  Rn.  Then,  their  HausdorfF  distance  is  defined 
as 


d(Xi,  X2)  :=  max  X2),  d(X 2,  Ai)} 


Fig.  5.  Domains  of  attraction  under  different  feedbacks. 


Example  4.1:  Let  A  =  [J  ~\fs]  and  b  =  [_°].  Then  /o  =  [0  3]. 
In  Fig.  5,  the  boundaries  of  the  domains  of  attraction  corresponding  to 
different  /  =  kf0i  k  =  0.50005,  0.65,  1,  3,  are  plotted.  The  regions 
do  become  bigger  for  greater  k.  The  outermost  boundary  is  dC.  When 
k  =  3,  it  can  be  seen  that  dS  is  already  veiy  close  to  dC. 


B.  Higher  Order  Systems  with  Two  Exponentially  Unstable  Poles 
Consider  the  following  open-loop  system: 


x(t)  =  Ax{t)  -f-  bu(t) 


Ai  0 

0  a2 


x(t)  + 


u(t) 


(14) 


where 


d(X i,  X2)  =  sup  inf  Hx,  —  acafl- 

xl£X1  X2€*2 

Here,  the  vector  norm  used  is  arbitrary. 

Let  P  be  the  unique  positive-definite  solution  of  the  following  Ric- 
cati  equation: 


A'P  -F  PA  -  Pbb'P  =  0.  (12) 


Note  that  this  equation  is  associated  with  the  minimum  energy  regula¬ 
tion,  i.e.,  an  LQR  problem  with  cost 


J  = 


u(t)u(t)  dt. 


The  corresponding  minimum  energy  state  feedback  gain  is  given  by 
/o  =  -6'P.  By  the  infinite  gain  margin  and  50%  gain  reduction  margin 
property  of  LQR  regulators,  the  origin  is  a  stable  equilibrium  of  system 


x(t)  =  Ax(t)  -f  ba(kf0x(t))  (13) 


where  x  =  [x'i  x'2]\  xi  6  R2,  x2  G  Rn,  A\  E  R2x2  is  anti¬ 
stable  and  A2  E  Rn  is  semi-stable.  Assume  that  ( A ,  b)  is  controllable. 
Denote  the  null  controllable  region  of  the  subsystem 

xi(t)  =  Aixi(t)  +  M(t) 

as  Ci ,  then  the  null  controllable  region  of  (14)  is  Ci  x  Rn[4].  Given 
7i ,  72  >  0,  denote 

Hi (71)  :=  {71^1  E  R2:  x\  E  Ci} 
n2(72):={x2ERn:i|rr2||<72}.  (15) 

When  71  =  1,  Hi  (71)  =  Ci  and  when  71  <  1,  Hi  (71)  lies  in  the 
interior  of  Ci .  In  this  section,  we  will  show  that  given  any  71  <  1  and 
72  >  0,  a  state  feedback  can  be  designed  such  that  Hi  (71)  x  ^2(72) 
is  contained  in  the  domain  of  attraction  of  the  equilibrium  x  =  0  of  the 
closed-loop  system. 

Fore  >  0,  letP(e)  =  [£}£>  E  R(2+n)x(2+n)  be  the  unique 

positive-definite  solution  to  the  ARE 

AfP  A  PA-  Pbb'P  +  e2 1  =  0.  (16) 


for  all  k  >  0.5.  Let  S(k)  be  the  domain  of  attraction  of  the  equilibrium 
rc  =  0  of  (13). 

Theorem  4.1:  limfc-*oo  d(S(k),  C)  =  0. 

Proof:  See  the  Appendix.  □ 

\  Note  that  the  use  of  high  gain  feedback  is  crucial  here.  The  minimum 
energy  feedback  fo  itself  does  not  give  a  domain  of  attraction  close 
to  C.  This  is  quite  different  from  the  related  result  in  [8]  and  [9]  for 
semistable  open-loop  systems.  In  these  two  papers,  it  was  shown  that 
if  ( A ,  B)  is  ANCBC,  then  low-gain  feedback  gives  arbitrarily  large 
domain  of  attraction. 


Clearly,  as  e  |  0,  P(e)  decreases.  Hence,  lim€_o  P(e)  exists. 
Let  Pi  be  the  unique  positive  definite  solution  to  the  ARE 


A[Pi  A  P\A\  —  Pibib[Pi  —  0. 


Then  by  the  continuity  property  of  the  solution  of  the  Riccati  equation 
[19] 


lim  P(e)  = 

e— *0 


"Pi 

0 


0 

0 
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Let  /(e)  :=  - brP(t ).  First,  consider  the  domain  of  attraction  of  the 
equilibrium  x  =  0  of  the  following  closed-loop  system: 


then  T(xio)  is  the  time  when  xio)  first  enters  the  ball  {xi  G 
R2:  ||xi[|  <  ri(e0)}.Let 


i(t)  =  Ax(t)  +  6<r(/(e)x(t)).  (17) 


Tm  =  max{T(xio):  xio  G  ^^1(71)}  (21) 


It  is  easy  to  see  that 

D(e)  :=  {*  £  R2+n:  x'P(e)x  <  l/||6'Pl/2(e)||2} 

is  contained  in  the  domain  of  attraction  of  the  equilibrium  a:  =  0  of 
(17)  and  is  an  invariant  set  Note  that  if  x0  G  D(c),  then  x(t)  G  D(e) 
and  |/(e)x(t)|  <  1  for  all  t  >  0.  That  is,  x(t)  will  stay  in  the  linear 
region  of  the  closed-loop  system,  and  in  D(e ). 

Lemma  4.1:  Denote 


n(e)  :=- 


f2(e)  ||6'P1/2(e)||' 


rs(e)  := 


-||P2(e)||  +  V'II^(0II2  +  3||Pi(€)||||P3(6 

\\Ps(e)\\ 


Then 


Di(e)  :=  {x  G  R2+n:  ||xx||  <  n(e),  |M  <  r2(e)}  C  D(e). 


Moreover,  lim€-^0r2(e)  =  00,  and  ri(e)  increases  with  an  upper 
bound  as  e  tends  to  zero. 

Proof:  It  can  be  verified  that 


||Pa(£)||r2(6)  +  2||P2(e)||r1(e)r2(e)+||P3(e)||r2(£) 


ii6'Pi/2(e)ir 


(18) 


So  for  all  x  €  Dx{e),  x'P(e)x  <  (l/||6'P1'2(e)||2),  i.c.,  Di(e)  C 
D(e).  By  the  definition  of  r,  (e)  and  r2(e),  we  have 


r2(e)  = 


3||A(e)|l 


||P2(e)||  +  V/II^WII2+  3||Pi (6)||  ||ft(e) 
1 


2 


A1/2(0 


||6'P1/2(e)|i 


Since  as  e  goes  to  zero,  P2(e),  Ps(e)  — *  0,  and  Pi  (e)  — ►  Pi,  so  ri(e) 
is  bounded  whereas  r2(e)  — ►  00.  It  follows  from  the  monotonicity  of 
P(e)  that  r  1  is  a  monotonically  decreasing  function  of  e.  □ 

Theorem  4.2:  Let  fo  =  ~b[Pi.  For  any  71  <  1  and  72  >0,  there 
exist  a  k  >  0.5  and  an  e  >  0  such  that  Hi  (71)  x  Q2  (72)  is  contained 
in  the  domain  of  attraction  of  the  equilibrium  x  =  0  of  the  closed-loop 
system 


x(£)  =  Ax(t)  +  bu(t) 


where 


“00  = 


x  D(e) 
x  G  J7(c). 


(19) 


(19) 


Proof:  Since  71  <  1,  by  Theorem  4.1,  there  exists  a  k  >  0.5 
such  that  ft  1(71)  lies  in  the  interior  of  the  domain  of  attraction  of  the 
equilibrium  xi  =  0  of 

)  xi  (t)  =  AiXi(t)  +  bic(kfoxi(t)).  (20) 


Let  eo  >  0  be  given.  For  an  initial  state  xio  G  Hi  (71),  denote  the 
trajectory  of  (20)  as  V>(t)  ^xo).  Define 

T(xio)  :=  min{t  >  0:  ||^(t,  xio)||  <  ri(e0)} 


and 

7=  max  ||e/,2‘||72+  f*  ||e'‘*<r*-T>62||  dr  (22) 

«€[o.rM]M  JQ  II  II 

then  by  Lemma  4.1,  there  exists  an  e  <  eo  such  that  n(e)  >  ri(eo), 
r2(e)  >  7  and 

Di{e)  =  {i£  R2+n:  ||xi||  <  n(e),  IM  <  r2(e)}  C  D(e) 

lies  in  the  domain  of  attraction  of  the  equilibrium  x  =  0  of  (17). 

Now  consider  an  initial  state  of  (19),  xo  G  Ox (71)  x  ^2(72).  If 
x0  G  -17(e),  then  x(t)  will  go  to  the  origin  since  D(c)  is  an  invariant 
set  and  is  contained  in  the  domain  of  attraction.  If  xq  £  D(e)i  we 
conclude  that  x(t)  will  enter  T(e)  at  some  T  <  Tm  under  the  control 
u  —  o-(kfoxi(t)).  Observe  that  under  this  control,  x\(t)  goes  along 
a  trajectory  of  (20).  If  there  is  no  switch,  xi  (t)  will  hit  the  ball  {xi  G 
R2:  ||xi||  <  ri(e0)}  at  T(xio).  Clearly  T(xio)  <  Tm  and  at  this 
instant  ||x2(T(xxo))||  <  7  <  r2(e),  so  x(T(xxo))  G  Di(e).Thus, 
we  see  that  if  there  is  no  switch,  x(t)  will  be  inDi(e)  atT(xio).  Since 
Di(e)  C  D(e),  x(t)  must  have  entered  D(e)  at  some  earlier  time 
T  <  T(x  10)  <  Tm.  So  we  have  that  conclusion.  With  the  switching 
control  applied,  once  x(t)  enters  the  invariant  set  T(e),  it  will  remain 
in  it  and  go  to  the  origin  asymptotically.  □ 

V.  Conclusion 

We  provided  a  simple  semiglobal  stabilization  strategy  for  exponen¬ 
tially  unstable  linear  systems  with  saturating  actuators.  For  a  planar 
antistable  system,  the  controllers  are  saturated  linear  state  feedbacks 
and  for  higher  order  systems  with  two  antistable  modes,  the  controllers 
are  piecewise  linear  state  feedbacks  with  only  one  switch. 


Appendix 

Proof  of  Theorem  4.1 

For  simplicity  and  without  loss  of  generality,  we  assume  that 


A  = 


0 

1 


-fli 

<22 


<21,  a2  >  0, 


Since  A  is  anti-stable  and  (A,  b)  is  controllable,  A,  b  can  always  be 
transformed  into  this  form.  Suppose  that  A  has  already  taken  this  form 
and  b  =  [j£] .  Let  V  =  [-A-1^  -6],  then  V  is  nonsingular  and  it  can 
be  verified  that  V~1AV  —  AandV”^  =  [_J]. 

With  this  special  form  of  A  and  6,  we  have 


P  = 


o-i 


0  a2 


fo  =  [0  2 02],  A  +  kbfo  =  [;  z+  =  -A-H  =  EJ  and 

z~  —  [  q1]  .  We  also  have  foA  =  0. 

For  a  given  k  >  0.5,  (13)  has  a  unique  limit  cycle  which  is  the 
boundary  of  S(k).  To  visualize  the  proof,  dC  and  dS(k)  for  some  k 
are  plotted  in  Fig.  6,  where  the  inner  closed  curve  is  dS(k ),  and  the 
outer  one  is  dC . 

We  recall  that  when  the  eigenvalues  of  A  are  real  [see  (6)] 


dC  = 


s: 


e-M  t~r)bdT 


(23) 
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p— (A+fc6/0)t 


1  <1,  Vt  €  [0,  T], 

2fca2  J 


We  also  note  that  the  upward  movement  of  the  trajectory  at  rci  and  y\ 
implies  that  Xu  <  (2k  —  l)/2fc,  yn  <  (1  —  2k) /2k. 

As  k  oo,  A  +  fcfe/o  =  [J  02£llafc)]  has  ^  distinct  real  eigen¬ 
values  — Ai  and — A2 .  (Their  dependence  on  k  is  also  omitted.)  Assume 
A2  >  Ai.  Since  AiA2  =  ax  and  Ai  +  A2  =  a2(2fc  -  1),  we  have 
limfc-^co  Ai  =  0,  lim*->oo  A2  =  +oo. 

With  the  special  form  of  A  -f  kbfo,  it  can  be  verified  that 


JA+kbf0)T 


A2  Ai  1  I"  e~~XlT  0  *^2  Ai 

=  1  1  J  L  0  e~x*T  J  [1  1  • 


Fig.  6.  The  domain  of  attraction  and  the  null  controllable  region, 
and  when  the  eigenvalues  of  A  are  complex  [see  (7)] 

8C  =  j±  [e~Mz7  -  J/  :  i  6  [0,T„]  J . 

(24) 

On  the  other  hand,  dS  (k)  is  the  limit  cycle  of  the  time  reversed  system 
of  (13), 

z(t)  =  -Az(t)  -  ba(kf0z(t )).  (25) 

jlere,  the  limit  cycle  as  a  trajectory  goes  clockwise.  From  the  proof  of 
Theorem  3.1,  we  know  that  the  limit  cycle  is  symmetric  and  has  two 
intersections  with  kfoz  =  1  and  two  with  kfoz  —  —  1,  see  Fig.  6.  Let 
T  be  the  time  required  for  the  limit  cycle  trajectory  to  go  from  yi  to 
xi7  andT2  the  time  from  *i  to  -yi,  then 

dS(k)  =  |±e“(j4+fc6/o)<yi:  *  6  [0,  Tj) 

U  |±  je^zi  -  jf  e-x(t-r)6dr]  :  t  €  [0,  T2]  j . 


Here  and  in  the  sequel,  the  dependence  of  *1,  yi,  T  and  T2  on  k  is 
omitted  for  simplicity. 

As  k — +  co,  the  distance  between  the  line  kf0z  =  1  and  kfoz  =  —  1 
approaches  zero.  By  comparing  (23),  (24)  and  (26),  we  see  that  to  prove 
the  theorem,  it  suffices  to  show 

lim  T  =  0,  lim  xi  =  lim  yi  ==  (or  zj) 

k — ►oo  k — ►  oo  k — t-oo 

lim  r2  =  oo(or  Tp). 

k — >-oo 

In  this  case,  the  length  of  the  part  of  the  limit  cycle  between  the  lines 
kfoz  =  1  and  kfoz  =  —1  will  tend  to  zero.  We  will  first  show  that 
limjt— oo  T  =  0. 

Let 


Hence,  from  (27),  we  obtain 

1  >2-Ai  +  A2e-^T-Aie-AiT 

Iu  ”  2 ka2  e~**T  -  e-^r 

1  A2-A,+A2eA2r-AieAlT 
3,11  “  2 ka2  e^T  _  e\2T 

Since i/u  <  (1- 2k)/2k  =  -(Ai  +  A2)/(2*<z2)  andeAlT -eAzT  < 
0,  we  have 

AieA2T  <  A2  -  Ai  +  A2eAir  <  2A2eAlT 


T  <  -r — — y-  =  -r — — r—  in  — =• 

A2  —  Ax  A2  —  Ai  a,  i 

noting  that  Ai  =  ai/A2.  Since  limjt^oo  A2  =  oo,  we  get 
limjt->oo  T  =  0.  It  follows  that 

2/u  A2-Ai+A2eA2T-AieAir 

k-^o  TTi  ~  «££»  (A2  -  Ai)e<*i+A*>r  +  A2e^T  -  AieA*T 

1  _i_  eAiT 

A2-A1:t-— nr 

t  l  +  eA2i  _  i 

~  ,  ex*T(l  +  ex'T)~ 

A2e^-Ai  /+eXg-— 

where  we  have  used  the  fact  that  limjt^co  Ai  =  0.  Since  xi  andyi  are 
bounded  by  the  null  controllable  region,  we  have 

lim  (yu  —  *n)  =  0-  (28) 


On  the  limit  cycle  of  (25),  we  also  have 

m  fT2 

~V\  —  e  AT2xi  ~  I  ( 


~A(.T2-r)bdr 


*11 

3/n 

1 

3/i  =  1 

2 &a2  J 

.  2fca2 

then  kf qX\  =  1,  kfoyi  —  -1 
f  *n  1 


j_  =e 
2kd2  ^ 


~(A+kbMT 


1  =  -e~AT '*  1  +(I-e~AT*)A-1b 

ka2  -  ^  2 ka.2  m 

Vn I  =  (I  —  e~AT2)A~1b 


y  ii  —  *11 

_ 1_  + 

2ka.2  - 
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It  follows  from  (28)  that 
lim  { 

k—+OC>  1 

Hence 

lim  [0  1]  (7+  e~ATs)~1(I  —  e~ATi)A~1b  =  0. 

k—+oo 

For  different  cases,  it  can  be  shown  from  the  above  equality  that 
1)  if  the  eigenvalues  of  A  are  real,  then 


yn 

0 


-  (7  +  e-AT2)-\l  -  e~AT2)A~ 


=0. 
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lim  7*2  =  co, 

k — ►oo 


lim  yi  =  lim  xx  =  lim 

k  — ►  oq  k— +oo  k — *oo 


y  ii 

o 


2)  if  the  eigenvalues  of  A  are  complex,  then 


lim  T2  =  Tp  , 

k—+oo 


lim  yi  =  lim  X\  =  lim 

k — >oo  k—*oo  k—*oo 


y  11 
0 


2s  • 


This  completes  the  proof. 


□ 
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Abstract — This  note  discusses  the  stabilization  and  spectrum  assignment 
problems  in  linear  periodically  time-varying  (LPTV)  continuous-time 
systems  with  sampled  state  or  output  feedback.  The  hybrid  nature  of  the 
overall  feedback  system  in  this  case  imposes  some  carefulness  in  handling 
classical  concepts  related  to  purely  LPTV  continuous-time  systems.  In 
particular,  this  note  points  out  the  fact  that  the  stabilization  of  such 
systems  by  periodic  feedback  gains  with  sampled  state  or  output  does  not 
imply  the  relocation  of  the  original  characteristic  exponents  of  the  LPTV 
systems  as  stated  previously  in  the  literature.  It  is  also  shown  that  the 
concept  of  monodromy  matrix  as  extended  to  LPTV  hybrid  systems  has 
not  all  the  features  of  a  true  monodromy  matrix. 

Index  Terms — Characteristic  exponents,  monodromy  matrix,  periodic 
systems,  sampled-data  feedback. 


I.  Introduction 

The  foundations  of  the  theory  of  periodic  systems  can  be  traced 
back  to  the  work  of  Floquet  who  first  brought  the  initial  time-varying 
system  into  a  transformed  equivalent  one  with  a  time-invariant  evolu¬ 
tion  matrix  [9].  An  important  result  of  Floquet  theory  states  that  the 
stability  of  a  linear  periodically  time-varying  (LPTV)  continuous-time 
system  can  be  inferred  from  the  location  of  the  eigenvalues  of  the  time- 
invariant  matrix  of  its  transformed  equivalent.  These  eigenvalues  are 
called  the  characteristic  exponents  or  Poincare  exponents  of  the  peri¬ 
odic  system.  In  control  engineering,  the  interest  for  continuous-time  pe¬ 
riodic  systems  is  mainly  motivated  by  numerous  application-oriented 
problems  such  as  sampled-data  control,  multirate  digital  control,  gen¬ 
eralized  hold  design,  control  of  mechanical  systems  in  rotation,  etc.  A 
central  issue  in  the  control  literature  centers  around  the  stabilization  of 
LPTV  continuous-time  systems  by  periodic  controllers  and  essentially 
two  different  approaches  have  been  used  for  the  design  of  such  sta¬ 
bilizing  controllers.  In  the  first  approach  [3],  the  input  to  the  periodic 
controller  is  a  continuous-time  signal,  whereas  in  the  second  approach, 
the  input  is  a  sampled  signal.  In  this  latter  case,  an  important  feature 
of  the  overall  system  is  its  hybrid  continuous/discrete  nature.  It  has 
been  shown  that  when  a  LPTV  system  is  controllable,  the  whole  “mon¬ 
odromy  matrix”  is  assignable  by  periodic  feedback  gains  with  sampled 
state  or  sampled  output  feedback  [6],  [1  ].  In  [4],  a  further  step  has  been 
taken  by  arguing  that  the  characteristic  exponents  are  all  relocated  with 
this  feedback  scheme.  This  note  motivated  by  this  last  statement  dis¬ 
cusses  issues  pertaining  to  the  relationship  between  the  stabilization 
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Abstract 

For  a  linear  system  under  a  given  saturated  linear  feedback,  we  propose  feedback  laws  that  achieve  semi-global  stabilization 
on  the  null  controllable  region  while  preserving  the  performance  of  the  original  feedback  law  in  a  fixed  region.  Here  by 
semi-global  stabilization  on  the  null  controllable  region  we  mean  the  design  of  feedback  laws  that  result  in  a  domain  of 
attraction  that  includes  any  a  priori  given  compact  subset  of  the  null  controllable  region.  Our  design  guarantees  that  the  region 
on  which  the  original  performance  is  preserved  would  not  shrink  as  the  domain  of  attraction  is  enlarged  by  appropriately 
adjusting  the  feedback  laws.  Both  continuous-time  and  discrete-time  systems  will  be  considered,  (c)  2001  Elsevier  Science 
B.V.  All  rights  reserved. 

Keywords:  Actuator  saturation;  Semi-global  stabilization;  Performance 


1.  Introduction 

We  revisit  the  problem  of  semi-globally  stabilizing 
a  linear  system  on  its  null  controllable  region  with 
saturating  actuators.  The  null  controllable  region,  de¬ 
noted  as  is  the  set  of  states  that  can  be  steered  to 
the  origin  of  the  state  space  in  a  finite  time  using  sat¬ 
urating  actuators.  The  problem  of  semi-global  stabi¬ 
lization  on  the  null  controllable  region  is,  for  any  a 
priori  given  set  9£  that  is  in  the  interior  of  the  null 
controllable  region  to  find  a  stabilizing  feedback 
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law  u  =  Fsc{x)  such  that  the  resulting  domain  of  at¬ 
traction  includes  S£  as  a  subset. 

This  problem  has  been  well  studied  for  systems 
that  are  so-called  asymptotically  null  controllable 
with  bounded  controls  (ANCBC). 2  In  particular,  it 
is  established  in  [6,7]  that,  in  both  continuous-time 
and  discrete-time,  a  linear  ANCBC  system  is 
semi-globally  asymptotically  stabilizable  on  its  null 
controllable  region  by  saturated  linear  feedback.  We 
note  that  in  this  case,  the  null  controllable  region  is 
the  entire  state  space.  The  key  to  the  possibility  of 
achieving  semi-global  stabilization  on  #  by  linear 


2  A  continuous-time  [resp.  discrete-time]  linear  system  is  asymp¬ 
totically  null  controllable  with  bounded  controls  if  it  is  stabilizable 
in  the  usual  linear  sense  and  has  all  its  open  loop  poles  in  the 
closed  left-half  plane  [resp.  the  closed  unit  disc]. 
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feedback  is  that  the  open  loop  system  is  ANCBC. 
In  general  saturated  linear  feedback  cannot  achieve 
semi-global  stabilization  on  #  if  the  open  loop  sys¬ 
tem  is  not  ANCBC,  although  there  have  been  many 
attempts  to  enlarge  the  domain  of  attraction  by  appro¬ 
priately  choosing  the  linear  feedback  gains  (see,  for 
example,  [3]  and  the  references  therein). 

Our  objective  in  this  paper  is  to  construct  nonlin¬ 
ear  feedback  laws  that  semi-globally  stabilize  a  lin¬ 
ear  system  (not  necessarily  ANCBC)  subject  to  actu¬ 
ator  saturation.  This  problem  has  been  addressed  be¬ 
fore.  In  particular,  it  was  established  in  [4,5]  that,  in 
both  continuous-time  and  discrete-time,  a  linear  sys¬ 
tem  with  only  two  exponentially  unstable  modes  can 
be  semi-globally  stabilized  on  its  null  controllable  re¬ 
gion  by  controllers  that  switch  between  two  linear 
feedback  laws.  By  defining  these  two  linear  feedback 
laws  on  an  appropriately  constructed  invariant  set,  it  is 
guaranteed  that  switching  would  occur  at  most  once. 
In  discrete-time,  general  systems  have  been  consid¬ 
ered  in  [1]  and  feedback  laws  were  constructed  that 
achieve  semi-global  stabilization  on  the  null  control¬ 
lable  region.  More  specifically,  a  sequence  of  poly¬ 
gons  are  constructed  that  approaches  the  null  control¬ 
lable  region  as  the  number  of  vertices  increases.  The 
vertices  divide  the  polygons  into  cones.  The  state  feed¬ 
back  laws  are  then  constructed  based  on  the  controls 
that  drive  the  vertices  of  a  polygon  to  the  origin  ac¬ 
cording  to  which  cone  the  state  belongs  to. 

In  this  paper  we  will  first  consider  a  general  linear 
system  subject  to  actuator  saturation, 

x(k  +  I  )=Ax(k)+Ba(u{k)\  x  <=  Un ,  u  €  IRm,  (1) 

where  a  is  the  standard  saturation  function.  With 
a  slight  abuse  of  notation,  we  use  the  same  sym¬ 
bol  to  denote  both  the  vector  saturation  func¬ 
tion  and  the  scalar  saturation  function,  i.e.,  if 
v  £  IRm,  then  a(v)  =  [<T(v1),a(v2),...,<T(vm)]T  and 
a(vi)  —  sgn(i>/)min{l,  |ty|}.  We  also  assume  that  a 
feedback  law  u  =  Fo(x)  has  been  designed  such  that 
the  resulting  closed-loop  system  in  the  absence  of  the 
saturation  function 

x(k  +  \)=Ax(k)  +  BFo  (x(k))  (2) 

has  the  desired  performance.  We  need  to  study  the 
stability  and  performance  of  the  actual  system  in  the 
presence  of  actuator  saturation, 

(3) 


Let  %  be  an  invariant  set  of  the  closed-loop  system 
and  be  inside  the  linear  region  of  the  saturation  func¬ 
tion:  { x  €  Rn:  IIFoOOHoo  ^1}.  For  example,  a  lin¬ 
ear  state  feedback  law  u  —  Fqx  could  be  constructed 
that  places  the  closed-loop  poles  at  certain  desired  lo¬ 
cations  and  can  be  a  level  set  of  the  form  {x  G 
Un:  xTPox  ^  1},  where  P0  >  0  satisfies 

(A  +  BF0)tPo(A  +  BF0)  -  P0  <  0.  (4) 

Suppose  that  is  in  the  linear  region,  then  it  is  an  in¬ 
variant  set  and  within  the  saturation  function  does 
not  have  an  effect  and  hence  the  desired  closed-loop 
performance  is  preserved. 

The  objective  of  this  paper  is  to  construct  feedback 
laws  that  semi-globally  stabilize  the  system  (1 )  on  its 
null  controllable  region  and  in  the  mean  time  preserve 
the  desired  closed-loop  performance  in  the  region  S)q. 
The  structure  of  our  feedback  laws  is  completely  dif¬ 
ferent  from  that  of  [  1  ] .  Instead  of  resorting  to  the  cones 
of  the  polygons  which  are  not  invariant  sets,  we  design 
our  controller  by  combining  a  sequence  of  feedback 
laws  u—Fi(: c),  i= 0, 1,...,A/,  in  a  way  that  the  union 
of  the  invariant  sets  corresponding  to  each  of  the  feed¬ 
back  laws  is  also  an  invariant  set,  which  is  shown  to 
be  in  the  domain  of  attraction.  By  appropriately  se¬ 
lecting  this  sequence  of  feedback  laws,  the  union  of 
the  invariant  sets  can  then  be  made  large  enough  to 
enclose  any  subset  in  the  interior  of  the  null  control¬ 
lable  region.  This  idea  was  made  feasible  by  the  use 
of  the  lifting  technique,  which  was  used  in  [2]  to  pro¬ 
vide  an  alternative  proof  of  the  results  of  [7]  men¬ 
tioned  earlier.  We  will  also  extend  the  above  results 
to  continuous-time  systems. 

This  paper  is  organized  as  follows.  In  Section  2  we 
propose  a  method  for  expanding  the  domain  of  attrac¬ 
tion  by  switching  between  a  finite  sequence  of  feed¬ 
back  laws.  This  switching  design  is  then  used  in  Sec¬ 
tion  3  to  show  that  the  domain  of  attraction  can  be 
enlarged  to  include  any  subset  in  the  interior  of  the 
null  controllable  region.  Section  4  extends  the  results 
of  Section  3  to  continuous-time  systems.  An  exam¬ 
ple  is  given  in  Section  5  to  illustrate  our  design  re¬ 
sults.  Finally,  a  brief  concluding  remark  is  made  in 
Section  6. 

2.  Expansion  of  the  domain  of  attraction 

Let  u  =  FOO,  i  =  0, 1, . . . ,  Af ,  be  a  finite  sequence 
of  stabilizing  feedback  laws.  Among  these  feedback 
laws,  u=F0(x)  can  be  viewed  as  the  feedback  law  that 


x(k  +  1  )  =  Ax(k)  +  Ba(F0(x(k))). 


T  Hu  et  al  I  Systems  &  Control  Letters  43  (2001)  203-210 


205 


was  originally  designed  to  guarantee  certain  desired 
closed-loop  perfonnance  in  a  given  region  and  the 
remaining  feedback  laws  have  been  introduced  for  the 
purpose  of  enlarging  the  domain  of  attraction  while 
preserving  the  regional  performance  of  the  original 
feedback  law  u  —  Fo(x). 

For  each  i  =  0, 1, . . .  ,M,  let  %  be  an  invariant  set 
inside  the  domain  of  attraction  of  the  equilibrium  x—0 
of  the  closed-loop  system  under  feedback  law  u  = 

x{k  +  1  )=Ax(k)  +  (5) 

Denote 

fl,  =  l  1 9h  i  =  0, 

7=0 

Then,  Q0  C  A  C  •  •  -  C  QM- 

Theorem  1.  For  each  i  =  0, 1, . . .  ,M,  fi,  is  an  invari- 
ant  set  inside  the  domain  of  attraction  of  x~Q  of  the 
closed-loop  system 


It  is  also  easy  to  see  that  Qi+\  is  an  invariant  set 
under  w  =  □ 

From  (7),  we  see  that  if*  e  Qo  =  ^OythQnu^F0(x) 
is  in  effect  and  hence  the  pre-designed  performance  is 
guaranteed  on 

For  later  use  in  Section  4,  it  can  be  verified  in 
a  similar  way  that  Theorem  1  is  also  true  for  a 
continuous-time  system  x(t)  =  f  (x,  w,  t\  in  particular, 

x(t)  =  Ax(t)  +  Bo(u(t)),  (9) 

with  a  set  of  stabilizing  feedback  laws  u  ~  Ffx),  i  = 
0, 1 , . . . ,  M.  In  the  context  of  continuous-time  systems, 
the  existence  and  uniqueness  of  the  solution  of  the 
closed-loop  system  equation  is  guaranteed  by  the  fact 
that  flf-*s  are  invariant  sets  and  nested  to  each  other. 
In  other  words,  a  trajectory  starting  from  a  set  A/  will 
remain  in  it.  Once  it  enters  a  smaller  set  Ay,  j  <  z,  it 
will  again  remain  in  it. 

3.  A  semi-global  stabilization  strategy 


*(*+!)  =  Ax{k)  +  Bo(Gi(x(k)l 
where 

'  Fo(x),  if  x  e  Q0, 
Fi(x),  if  x€  Qi\Q0, 

G,(x):= 


(6) 


(7) 


l  F(x),  if  x  €  Qj\Qi-i. 

Here  we  note  that,  for  each  z=  1, 2, . . . ,  M,  A,\ Af_  j  = 

r 


^\Uto% 


Proof.  We  prove  the  theorem  by  induction.  The  state¬ 
ment  is  trivially  true  for  i  =  0.  Suppose  it  is  true  for 
i  >  0,  we  need  to  show  that  it  is  also  true  for  i  +  1. 
Let  us  write  Gl+i(x)  as 

„  ,  x  f  <?/(*)>  if  x  e  Q„ 

Gi+i(x)=  (8) 

F+i(x),  if  xe  Qi+i\£2t. 

Ifx(O)  £  Qh  then  under  the  feedback  u=Gfx),  x{k)  e 
Qi  for  all  k  and  lim*-^  x(k)  =  0.  If  x(0)  £ 
Qi+i\Qi  =  ®,-+1\Qf,  since  is  inside  the  domain 
of  attraction  under  the  feedback  u  =  FM(x)  and  A,- 
is  a  neighborhood  of  the  origin,  x(k)  will  enter  A/  at 
some  k\  <  oo.  After  that,  the  control  is  switched  to 
u  —  Gfx)  and  by  the  foregoing  argument,  we  also 
have  lim*— oo  *(Jk)  =  0.  This  shows  that  QM  is  inside 
the  domain  of  attraction. 


In  this  section,  we  utilize  the  lifting  technique  to 
design  a  sequence  of  ellipsoids  that  cover  any  pre¬ 
scribed  compact  subset  of  the  null  controllable  region. 
Each  ellipsoid  is  invariant  and  in  the  domain  of  attrac¬ 
tion  for  the  lifted  closed-loop  system  under  an  appro¬ 
priately  chosen  linear  feedback.  This,  by  Theorem  1, 
would  achieve  semi-global  stabilization  for  the  lifted 
system,  and  hence  for  the  original  system. 

The  null  controllable  region  of  (1)  at  step  K>  de¬ 
noted  as  is  the  set  of  states  that  can  be  steered 

to  the  origin  in  K  steps  [5].  We  see  that  x0  £  #(. K ) 
if  and  only  if  there  exists  a  control  w(-),  ||i/(Jt)||oo  ^ 
1,  k  =  0, 1,...,^  -  1,  such  that 

K-\ 

AKx0  +  A^^Bufi)  =  0.  (10) 

1=0 

The  null  controllable  region,  denoted  as  is  the  set 
of  states  that  can  be  steered  to  the  origin  in  a  finite 
number  of  steps.  Clearly,  #  =  \JK>0  %{K)  and  it  can 
be  shown  by  standard  analysis  that  any  compact  subset 
of  #  is  a  subset  of  #(. K )  for  some  K.  For  simplicity, 
we  assume  that  the  pair  (A,B)  is  controllable  and  A 
is  nonsingular.  Then  there  is  an  integer  no  ^  n  such 
that,  for  all  K  ^  no ,  %>( K )  contains  the  origin  in  its 
interior  and  is  bounded. 

For  a  positive  integer  L ,  the  lifted  system  of  (1) 
with  step  L  is  given  by 

*L(k+  1  )=ALxi(k)-\-BLa(uL(k)),  (11) 
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where 

r  u(W)  i 

xL(k)  =  x(kL ),  uL(k)  =  I  u(kL+ 1)  j, 

'u{kL  +  L-\y 

Al=Al,Bl  =  [Al-'BAl-2B  AB  B].  (12) 

We  have  more  flexibility  in  the  design  of  a  system  by 
using  the  lifting  technique  because  it  allows  us  to  see 
further  the  effect  of  a  control  law  and  to  consider  the 
combined  effect  of  the  control  action  at  several  steps. 

For  a  feedback  matrix  F  £  xn,  denote  the  unsat¬ 
urated  region  (linear  region)  of  the  closed-loop  system 

xL(k  +  1  )  =  ALxL(k)  +  Bi<r(Fxi(k))  (13) 

as 

#(F):={x  £  R":  \fjx\  <  1J  =  1,2,...,  ml}, 

where  f  j  is  the  yth  row  of  F.  If  L  ^  no ,  then  there 
exists  an  F  such  that  Al  +  BlF  =  0.  For  such  an  F , 
there  is  a  corresponding  J§?(F)  and  for  all  xl0  =  xo  G 
i?(F),  AlXo  4-  Fx<7(Fx0)  =  (4r  4-  FxF)x0  =  0.  Hence 
^(F)  is  an  invariant  set  of  the  lifted  system  (13)  and 
is  inside  the  domain  of  attraction. 

For  a  positive  definite  matrix  P  £  R”xn,  denote 

'  <?(P)  =  {xe  Un:  xrPx  <  1}. 

Suppose  that  &(P)  C  JSf(F),  then  under  the  feedback 
law  Ul  =  Fxl,  ${P)  is  also  an  invariant  set  inside  the 
domain  of  attraction.  Here  we  are  interested  in  the  el¬ 
lipsoids  because  they  can  be  generalized  to  the  Lya¬ 
punov  level  sets  for  the  case  Al  4-  BlF  ^  0.  We  will 
show  that  any  compact  subset  of  the  null  controllable 
region  can  be  covered  by  the  union  of  a  finite  set  of 
such  ellipsoids. 

Lemma  1.  Given  an  integer  L  ^  no  and  a  posi¬ 
tive  number  /?  <  1,  there  exists  a  family  oj  F  e 
UniLxn,  i  =  1,2,..., AT,  with  corresponding  positive 
definite  matrices  Pi's,  such  that  Al  4-  BlF  =  0, 

£{Pt)  C  J2TO  i  =  1,2, 
and 

M 

P<#(L)c\  k (/?), 

w/zere  /?#(£)  =  {j?x:  x  G  #(L)}. 

Proof.  Let  <3(/?#(L))  be  the  boundary  of  /?#(£). 
Firstly,  we  show  that,  there  exists  an  e  >  0  such  that, 
for  any  Xi  G  £(/?#(£)),  there  exist  anF  e  RwI,x"  and 


P  >  0  that  satisfy 


Al  +  BlF  =  0  and  %fi)C#(?)CJSf(F), 

where  ^(jq, e)={i6  R”:  ||x  —  Xi ||2  ^  e}. 

Let  e t  be  the  unit  vector  in  Un  whose  dth  element  is 
1  and  other  elements  are  zeros.  For  simplicity,  assume 
x\  —ye  1 ,  otherwise  we  can  use  a  unitary  transformation 
x  — >  Vx,  VTV  =  I ,  to  satisfy  this.  Note  that  a  unitary 
transformation  is  equivalent  to  rotating  the  state  space 
and  does  not  change  the  shapes  of  SS(x\, s),  &(P)  and 

TO 

Since  x\  =  ye\  G  /? #(F),  it  follows  from  (10)  and 
(12)  that  there  exists  a  ulu  ||wi<i||oo  ^  such  that 

ALye  1  4-  BLuL\  =  0.  (14) 


Define 

__  max{||x||2:  x  G 
^  min{[|x||2:  x  G  d^(L)}  ’ 

Since  L  >  no,  *£( L )  includes  the  origin  in  its  inte¬ 
rior  and  p  <  00.  It  follows  that  ye t  G  pP^(L)  for  all 
i  >  2.  Therefore,  for  each  /  ^  2,  there  exists  a 
wzy,  ||«zj  <  pfi,  such  that 

Aiye^  +  BLuu  =  0.  (15) 


Let  F  —  {///}  be  chosen  as 
F=  -[uLX  uL2 

then  | fji\  ^  jS/y  and  |/>|  <  ^0/y  for  =  2,...,n 
and  j  —  l,2,...,mZ.  From  (14)  and  (15),  we  have 

04x  +  BlF)c ;  =  +  -BlUls  =  0,  /  =  1, 2, . . . ,  w. 

T 

This  shows  that  Al  4-  BlF  =  0. 

Let 

\  Pi  0 

P  = 

0  Plln^  1_ 


where 


Let  ymin  =  min{||x||:  x  G  d(P<£(L))}  and 


2y/Z=T)Pn  \  }  ' 
\/4  —  (/?  +  1  )2  /  J 
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Then  ||P1/2||2e  ^  1  -  2/?/(/?  +  1).  Note  that  e  is  inde¬ 
pendent  of  7  and  a  particular  x\ . 

We  also  have 


which  implies  that  &(P)  C  JSf(P).  To  see  this,  we 
verify  that,  for  any  x  €  S(P\ 

\fjx\  =  \fjP-V/2)Pl/2x\ 

<  (fjP-'f])ll2(xTPx)m  <  1. 

For  *  €  «(xi,  £),  we  have 

||P,/2*||2  ^  ||P1/2jci||2  +  ||-P,/2(jc-*i)I|2 
<  +  ll^lbe  <  1. 

This  shows  that  xrPx  ^  1  and  hence  8S(x\,e.)  C 
S(P)  C  % ’(F). 

Because  c(fiF(L))  is  a  compact  set,  there  exists  a 
finite  set  of  xf  €  d(P<g(L)),  i  =  such  that 

d(P^(L))  C  U£,  38(xi,E).  By  the  foregoing  proof, 
we  know  that  for  each  x,  <E  d(p^{L)),  there  exist  an 
Ft  and  Pt  such  that  Al  +  BiF  =  0  and 

SS{xuz)  C  £{Pi)  C 

Hence, 

M 

OT))c|J^(il). 

i=l 

It  then  follows  that 

M 

mL)c  \jm)- 

1=1 

To  see  this,  for  any  x  e  P%{L),  let  y  be  an  intersec¬ 
tion  point  of  d(pV(L))  with  the  straight  line  passing 
through  the  origin  and  x.  Hence,  y  €  S(Pi0 )  for  some 
iq.  Since  £(Pi0)  is  convex  and  contains  the  origin,  x  £ 
□ 

Remark  1.  We  would  like  to  point  out  that,  the  family 
of  Ffs  may  contain  repeated  members  with  different 
Pi's.  This  is  the  case,  for  example,  when  the  system 
has  a  single  input  (m  =  1 )  and  the  lifting  step  L  is 
the  same  as  n ,  the  dimension  of  the  state  space.  In 
this  case,  we  have  only  a  unique  Ft  =  —BfxAi  with 


Lemma  1  shows  that  PV(L)  can  be  covered  by  a 
finite  number  of  ellipsoids  and  within  each  ellipsoid 
there  is  a  corresponding  linear  feedback  law  such  that 
the  state  of  (1 1 )  will  be  steered  to  the  origin  the  next 
step,  or  equivalently,  the  state  of  ( 1 )  will  be  steered  to 
the  origin  in  L  steps.  Because  p  can  be  made  arbitrar¬ 
ily  close  to  1  and  L  can  be  made  arbitrarily  large,  any 
compact  subset  of  can  be  covered  by  a  family  of 
such  ellipsoids.  It  should  be  noted  that  as  J?  gets  closer 
to  1,  e  will  decrease  and  we  need  more  ellipsoids  to 
cover  P^(L\  although  the  determination  of  these  el¬ 
lipsoids  could  be  technically  involved  for  higher  order 
systems.  Also,  in  the  above  development,  we  need  to 
lift  the  system  by  L  steps  to  cover  P^(L).  Actually,  the 
lifting  step  can  be  reduced  if  we  replace  the  dead-beat 
condition  AL  +  BLF  =  0  with  a  less  restrictive  one: 

(At  +  BzF)tP(Al  +  BlF)  -  cP  <  0, 

where  c  6  (0, 1 )  specifies  the  requirement  of  the  con¬ 
vergence  rate.  A  direct  consequence  of  Lemma  1  is 

Theorem  2.  Given  any  compact  subset  Xq  of  and  a 
number  c  6  (0, 1),  there  exist  an  L  ^  1  and  a  family 
of  Ff  e  RmLx”,  i—  1,2,..., A/,  with  corresponding 
positive  definite  matrices  Pi's,  such  that 

(Al  +  BLFi)yPi(AL  +  BlF, )  -  cPj  <  0,  (17) 


S(P)  C  <e(F),  i  =  (18) 

and 

M 

JfocU^(Pi).  09) 

1=1 


Because  of  (17)  and  (18),  <f(P)  is  an  invariant  set 
inside  the  domain  of  attraction  for  the  closed-loop  sys¬ 
tem 


xL(k  +  1 )  =  Azxz(F)  +  Bio(F,xL(k)). 


By  Theorem  1,  we  can  use  a  switching  controller 
to  make  £(B)  inside  the  domain  of  attraction. 
Once  the  state  enters  the  region  S(Pq),  the  controller 
switches  to  the  feedback  law 


uL(k)  =  F0(xL(k))  = 


Fo(xt(k)) 

F0(x(kL  +  l)) 


(20) 


F0(x(kL  +  L-\)) 
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where  the  variables  x(kL+ i  ),  i  =  1, 2, . . . ,  L—  1 ,  can  be 
recursively  computed  from  the  state  xi(k)  as  follows: 

x(kL  +  1 )  =  AxL(k)  -f  BF0(xL(k)), 

x(kL  +  2)  =  Ax(kL  +  1 )  +  BFq(x(JcL  +  1 ) 

~A(AxL(k)  +  BF0(xL(k))) 
+BF0(AxL(k)+BF0(xL(k))) 

x(kL  +  z  +  1)  =  Ax{kL  +  z)  +  BFo(x(kL  -f  z)). 

Since  feedback  law  (20)  corresponds  to  u  =  i^(x) 
in  the  original  time  index,  under  which  S(Pq)  is  an 
invariant  set,  £(Pq)  is  also  an  invariant  set  under  feed¬ 
back  law  (20)  in  the  lifted  time  index  and  the  desired 
performance  in  this  region  is  preserved. 

We  also  observe  that,  due  to  the  switching  and 
lifting  that  are  involved  in  the  construction  of  feed¬ 
back  laws,  our  final  semi-globally  stabilizing  feedback 
laws,  when  implemented  in  the  original  system  (1), 
are  nonlinear  and  periodic  in  time. 

4.  Continuous-time  systems 

In  this  section,  we  consider  the  continuous-time 
counterpart  of  the  system  (1) 

x(t)=Ax(t)  +  Bo(u(t)\  xGR\  uef.  (21) 

The  null  controllable  region  at  time  T ,  denoted  as 
#(T),  is  the  set  of  states  that  can  be  steered  to  the 
origin  in  time  T  by  a  measurable  control  input  u.  The 
null  controllable  region,  denoted  as  is  Ur^o  ^(T). 

Let  h  >  0  be  the  lifting  period.  We  are  now  inter¬ 
ested  in  controlling  the  state  of  (21)  at  times  kh ,  k  = 
1,2,...  . Denote Xh{k)=x(kh)  and uh(k>x)~u(kh+x). 
Let  Ah  =  e'4*;  then  the  lifted  system  is 

fh 

xh(k+  l)=Ahxh(k)  +  '  e^A  x)B<j(uh(k,x))&x. 
o 

(22) 

Denote  the  set  of  m  x  n  dimensional  measurable 
functions  defined  on  [0,/z)  as  With  a  matrix 

function  F  G  $Fmxny  let  the  feedback  control  be 
Uh(k,x)  =F(x)xh(k).  Then  the  closed-loop  system  is 

xh(k  +  1 )  =  Ahxh(k)  +  fh  tA(-h~x)Ba{F{x)xh(k))  dt. 

0 

(23) 


The  unsaturated  region  of  the  feedback  law  is  then 
given  by, 

JS?(F):={x  €  R"  :  |//r)x|  <  1, 

j  =  x  €  [0,/i)}, 

where  fj  €  $/x\y.n  js  tjje  yth  row  of  F.  If  x/,(k)  G 
JSf(F),  then  a(F(x)xh(k))  =  F(x)xh(k)  and 

(  rh  \ 

xh(k+  1)=  Ah+  '  eA(h  x)BF(x)  dt  xh(k).  (24) 
0 

The  feedback  w/,(Ar,  x  )=F(x)xh(k)  is  stabilizing  if  there 
exists  P  >  0  such  that 

(  rh  \T 

Ah+  1  ^h~x'>BF{x)Ax 
0 

(  fh  \ 

xP  Ah+  1  ^h~x)BF(x)ix  -P^O. 

0 

Note  that  P  can  be  scaled  such  that  £{P)  C  FF{F).  In 
this  case,  &(P)  is  an  invariant  set  inside  the  domain 
of  attraction  for  the  system  (23  ).  Since  for  all  Xh{k)  G 
&(P\  the  control  is  linear  in  */,(£),  so,  when  Xh(k ) 
tends  to  the  origin,  the  control  Uh(k,  i)  =  F{x)xu{k) 
will  gets  smaller  and  hence  the  state  of  the  original 
system  (21 )  between  t  =  kh  and  t  —  (k  -f  1  )h  will  stay 
close  to  Xh{k).  Similar  to  the  discrete-time  case/  we 
have  the  following  lemma. 

Lemma  2.  Given  h>  0  and  a  positive  number  /?  <  1, 
there  exists  a  family  of  Ft  £  i  =  1,2, 

with  corresponding  positive  definite  matrices  Pfs, 
such  that 

rh 

Ah+  1  ^h~x)BFi(x)dx  =  0, 

0 

^)C^),  J  =  1,2, . .  ,,Af, 

and 

M 

p%(h)  C  I  k(f>). 

1 

Proof.  The  idea  of  the  proof  is  the  same  as  that  of 
Lemma  1.  Here  we  just  show  how  to  construct  £,  F 
and  P  for  a  given  xj  G  S(/?#(/z)).  We  also  assume  that 
X\  =  ye ].  Since  ye\  G  3(/?#(/z)),  there  exists  a  u\  G 
^mx\  ||wi(t)||oo  <  P  for  all  x  G  [0,/z),  such  that 

Ahje  i  +  zA^h~x)Bu\(x)&x  —  0, 

o 


T.  Hu  et  al  f  Systems  &  Control  Letters  43  (2001)  203-210 


209 


andforif  >  2,  there  exists  a  e  izrmXl,  ||k/(t)||oo  < 
ftp  for  all  r  e  [0,/z),  such  that 

fh 

A^ye^A-  t)j5w/(t)c1t  =  0. 

o 

Let  F  =  l/y[«i  «2  •  •  •  ««],  and  P,  e  be  the  same  as 
those  in  the  proof  of  Lemma  1,  the  remaining  part  of 
the  proof  will  be  the  same  as  that  of  Lemma  1  except 
that  (16)  is  replaced  with 

<  1,  Vt  e  [0,h),  j  =  1,2,. ...w.  □ 

The  following  is  the  counterpart  of  Theorem  2  for 
the  discrete-time  system  (1). 


Theorem  3.  Given  any  compact  subset  X$  of  *€  and  a 
number  c  e  (0, 1),  there  exist  an  h>  0  and  a  family 
of  Ft  6  J2™*",  i  =  1,2,...,  A/,  with  corresponding 
positive  definite  matrices  P^s,  such  that 

QA(h~x^SFi(r)  dt^ 


{Ai+l 
*P'(A,+ 1 


-cPi  ^  0, 


A/ 


Fig.  1.  The  union  of  the  invariant  ellipsoids. 


Fig.  2.  A  trajectory  under  the  multiple  switching  control. 


Again,  by  Theorem  1,  we  can  use  a  switching  con- 
trailer  to  make  \J?=0£(Pi)  inside  the  domain  of  at¬ 
traction  and  hence  semi-global  stabilization  can  be 
achieved.  Moreover,  once  the  state  enters  the  region 
£(P0),  the  controller  switches  to  the  feedback  law 
u  =  Fq(x)  and  hence  the  desired  performance  in  this 
region  is  preserved. 


5.  Example 

Consider  the  system  (1)  with 


'0.8876 

-0.5555 ' 

"  —0.1124' 

,  B  = 

0.5555 

1.5542 

0.5555 

The  matrix  A  is  exponentially  unstable  with  a 
pair  of  eigenvalues  1.2209  =h  j 0.4444.  The  LQR 
controller  corresponding  to  the  cost  function  J~ 
£(x(A)T<2*(*)  +  u{kfRu(k)\  with  Q  =  /,  R  =  1  is 


u— F0(x)=[  -0.2630  -2.1501  ]x.  Let  be  obtained 
as 


2.1367  -0.2761 
-0.2761  1.7968 


see  the  ellipsoid  enclosed  by  the  solid  curve  in  Fig.  1. 

To  enlarge  the  domain  of  attraction,  we  take  a  lift¬ 
ing  step  of  8  and  obtain  16  invariant  ellipsoids  with 
corresponding  feedback  controllers,  see  the  ellipsoids 
enclosed  by  the  dotted  curves  in  Fig.  1 .  Each  invari¬ 
ant  ellipsoid  is  optimal  with  respect  to  certain  Xi  in  the 
sense  that  it  contains  ox,-  with  |a|  maximized,  see  the 
points  marked  with  This  is  computed  by  using  the 
LMI  method  [3].  The  outermost  curve  in  Fig.  1  is  the 
boundary  of  the  null  controllable  region  c€.  We  see 
that  the  union  of  the  ellipsoids  covers  a  large  portion 
of 

Figs.  2-4  show  some  simulation  results  of  the 
closed-loop  system  under  the  multiple  switching 
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Fig.  3.  Simulation:  jq,  *-*;  *2>  *-'• 


Fig.  4.  Simulation:  the  control 

controls.  The  initial  state  is  very  close  to  the  bound- 
aiy  of  In  Fig.  2  the  dashed  trajectory  is  that  of 
the  unlifted  system  (1)  under  the  switched  control, 
and  the  traj  ectory  of  the  lifted  system  is  marked  with  ‘  *  l 


Figs.  3  and  4  are  the  state  and  control  of  the  original 
unlifted  system. 

6.  Conclusions 

In  this  paper,  we  have  proposed  a  control  design 
method  for  linear  systems  that  are  subject  to  actua¬ 
tor  saturation.  This  design  method  applies  to  general 
(possibly  exponentially  unstable)  systems  in  either 
continuous-time  or  discrete-time.  The  resulting  feed¬ 
back  laws  expand  the  domain  of  attraction  achieved 
by  an  a  priori  designed  feedback  law  to  include  any 
bounded  set  in  the  interior  of  the  null  controllable  re¬ 
gion,  while  preserving  the  desired  performance  of  the 
original  feedback  law  in  a  fixed  region. 
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Abstract 

It  is  established  that  a  SISO  linear  stabilizable  and  detectable  system  subject  to  output  saturation  can  be  semi-globally 
stabilized  by  linear  output  feedback  if  all  its  invariant  zeros  are  in  the  closed  left-half  plane,  no  matter  where  the  open 
loop  poles  are.  This  result  complements  a  recent  result  that  such  systems  can  always  be  globally  stabilized  by  discontinuous 
nonlinear  feedback  laws,  and  can  be  viewed  as  dual  to  a  well-known  result:  a  linear  stabilizable  and  detectable  system  subject 
to  input  saturation  can  be  semi-globally  stabilized  by  linear  output  feedback  if  all  its  poles  are  in  the  open  left-half  plane,  no 
matter  where  the  invariant  zeros  are.  ©  2001  Elsevier  Science  B.V.  All  rights  reserved. 

Keywords:  Semi-global  stabilization;  Saturation;  Low  gain  feedback;  High  gain  feedback 


1.  Introduction 

Physical  limitations  on  actuators  and  sensors  often 
cause  the  control  input  and/or  measurement  output  to 
saturate.  In  control  design,  it  is  thus  necessary  to  take 
the  effects  of  input  and/or  output  saturation  into  ac¬ 
count. 

While  input  saturation  has  been  addressed  in  much 
detail  in  the  literature  (see,  for  example,  [1]  and  the 
references  therein),  fewer  results  are  available  that 
deal  with  output  saturation.  For  example,  issues  re¬ 
lated  to  the  observability  of  a  linear  system  subject  to 
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output  saturation  were  discussed  in  detail  in  [3].  A 
discontinuous  dead  beat  controller  was  recently  con¬ 
structed  for  single  input  single  output  (SISO)  linear 
systems  in  the  presence  of  output  saturation  [2]  that 
drives  every  initial  state  to  the  origin  in  a  finite  time. 

In  this  paper,  we  consider  the  problem  of 
semi-globally  stabilizing  linear  systems  using  linear 
feedback  of  the  saturated  output  measurement.  Here, 
by  semi-global  stabilization  we  mean  the  construction 
of  a  stabilizing  feedback  law  that  yields  a  domain  of 
attraction  that  contains  any  a  priori  given  (arbitrar¬ 
ily  large)  bounded  set.  This  problem  was  motivated 
by  its  counterpart  for  linear  systems  subject  to  input 
saturation  [5].  More  specifically,  it  was  established  in 
[5]  that  a  linear  system  subject  to  input  saturation  can 
be  semi-globally  stabilized  using  linear  feedback  if 
the  system  is  stabilizable  and  detectable  in  the  usual 
linear  sense  and  all  its  open  loop  poles  are  in  the 
closed  left-half  plane,  no  matter  where  the  invariant 
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zeros  are.  What  we  will  show  in  this  paper  is  that 
a  single  input  single  output  linear  system  subject  to 
output  saturation  can  be  semi-globally  stabilized  by 
linear  output  feedback  if  the  system  is  stabilizable 
and  detectable  in  the  usual  linear  sense  and  all  its 
invariant  zeros  are  in  the  closed  left-half  plane,  no 
matter  where  the  open  loop  poles  are.  This  result  thus 
complements  the  results  of  [2]  in  the  sense  that,  it 
requires  an  extra  condition  that  the  invariant  zeros  of 
the  system  be  on  the  closed  left-half  plane  to  con¬ 
clude  semi-global  stabilizability  by  linear  feedback. 
It  can  also  be  viewed  as  dual  to  its  input  saturation 
counterpart  in  [5].  We,  however,  note  that  in  the  dual 
situation  [5],  the  condition  of  all  poles  being  in  the 
closed  left-half  plane  is  necessary  even  with  nonlinear 
feedback  [7],  while  in  the  current  situation,  the  condi¬ 
tion  of  all  invariant  zero  being  in  the  closed  left-half 
plane  is  not  necessary  with  nonlinear  feedback  (by 
the  result  of  [2]).  It  is  not  clear  at  this  time  if  it  would 
become  necessary  for  linear  feedback. 

Although  this  result  can  be  viewed  as  dual  to  its  in¬ 
put  saturation  counterpart  in  [5],  the  mechanisms  be¬ 
hind  the  stabilizing  feedback  laws  are  completely  dif¬ 
ferent.  In  the  case  of  actuator  saturation,  we  construct 
low  gain  feedback  laws  that  avoid  the  saturation  of 
the  input  signal  for  all  initial  states  inside  the  a  priori 
given  set  and  the  closed-loop  system  behaves  linearly. 
Here  in  the  case  of  output  saturation,  the  output  ma¬ 
trix  is  fixed  and  the  output  signal  is  always  saturated 
for  large  initial  states.  Once  the  output  is  saturated,  no 
information  other  than  its  sign  is  available  for  feed¬ 
back,  Our  linear  feedback  laws  are  designed  in  such 
a  way  that  they  use  the  saturated  output  to  cause  the 
system  output  to  oscillate  into  the  linear  region  of  out¬ 
put  saturation  function  and  remain  in  there  in  a  finite 
time.  The  same  linear  feedback  laws  then  stabilize  the 
system  at  the  origin.  This  is  possible  since  all  the  in¬ 
variant  zeros  are  in  the  closed  left-half  plane  and  the 
feedback  gains  can  be  designed  such  that  the  over¬ 
shoot  of  the  output  is  arbitrarily  small. 

The  precise  problem  formulation  and  the  main  re¬ 
sults  are  presented  in  Section  2,  which  also  concludes 
the  paper  with  some  simulation  results. 

2.  Main  results 

Consider  the  following  single  input  single  output 
linear  system  subject  to  output  saturation, 

x  =  Ax  +  Bu,  x  6  I R",  u  e  U3 

y  =  a(Cx\  yeU,  (1) 


where  cr  :  [R  — ►  (R  is  the  standard  saturation  function, 
i.e.,  <r(u)  =  sign(w)min{a,  |w|}.  Our  main  results  on 
semi-global  stabilizability  of  the  system  (1)  is  given 
in  the  following  theorem. 

Theorem  L  The  system  ( 1 )  is  semi-globally  asymp¬ 
totically  stabilizable  by  linear  feedback  of  the  satu¬ 
rated  output  if 

•  The  pair  ( A,B )  is  stabilizable ; 

•  The  pair  (A,  C)  is  detectable ;  and 

•  All  invariant  zeros  of  the  triple  (A,B,  C )  are  in  the 
closed  left-half  plane. 

More  specifically,  for  any  a  priori  given  bounded  set 
%o  C  U2n,  there  exists  a  linear  dynamic  output  feed¬ 
back  law  of  the  form 

z  =  Fz  +  Gy,  z  €  IR7', 

(2) 

u  =  Hz  +  H0y , 

such  that  the  equilibrium  (xyz)  =  (0,0)  of  the 
closed-loop  system  is  asymptotically  stable  with  2£0 
contained  in  its  domain  of  attraction. 

Proof.  We  will  establish  this  result  in  two  steps.  In 
the  first  step,  we  will  construct  a  family  of  feedback 
laws  of  the  form  (2),  parameterized  in  e  e  (0, 1],  In  the 
second  step,  we  will  show  that,  for  any  a  priori  given 
bounded  set  2£q  C  IR2”,  there  exists  an  e*  €  (0, 1]  such 
that,  for  each  s  e  (0,  e*],  the  equilibrium  (x,z)= (0, 0) 
of  the  closed-loop  system  is  asymptotically  stable  with 
contained  in  its  domain  of  attraction. 

The  construction  of  the  feedback  laws  follows  the 
following  algorithm. 

Step  1.  Find  a  state  transformation  [6], 

x  =  Tx,  x  =  [xj  x[]T,  xi  =  [xu  xn  ■■■  xlr]7, 

such  that  the  system  can  be  written  in  the  following 
form: 

*0  =  A0x0  +  BoXi  1 ,  *0  €  IR"0, 

111  =*12, 

112  =*13, 


xlr  =  C0x0  +  aiXn  +  a2*i2  H - t-  arxlr  +  u, 

y  =  a(x  n), 


(3) 
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where  (Aq,Bo)  is  stabilizable  and  the  eigenvalues  of 
Aq  are  the  invariant  zeros  of  the  triple  (A,B,C)  and 
hence  are  all  in  the  closed  left-half  plane. 

We  note  that  the  multiple  input  multiple  output 
counterpart  of  the  above  canonical  form  will  in  gen¬ 
eral  also  require  a  transformation  on  the  input  and  the 
output.  The  later  cannot  be  performed  due  to  the  pres¬ 
ence  of  output  saturation. 

Step  2.  Let  Fo(fi)  be  such  that 

A(4o4£o^o(e))={~£H~^o04o)}  U  A-(Ao),  e  E  (0, 1], 

where  Ao(Ao)  and  A- (A 0)  denote  respectively  the  sets 
of  eigenvalues  of  A0  that  are  on  the  imaginaiy  axis  and 
in  the  open  left-half  plane.  It  is  clear  that  A0  +B0F0(e) 
is  Hurwitz  for  any  e  e  (0,  l]  and 

li^oOOH  V«€(0,1],  (4) 

for  some  «o  independent  of  e. 

Such  an  F0(e)  exists  since  (A0>B0)  is  stabiliz¬ 
able.  We  summarize  some  properties  for  the  triple 
(.4o,^o»^o(e))  from  [4,  Lemmas  2.2.3  and  2.2.4  and 
Theorem  3.3.1]. 

Lemma  1.  For  the  given  triple  (Aq,Bq,Fo(e)),  there 
exists  a  nonsingular  matrix  T0(z)  c  Un°xnQ  such  that 

||7o(e)||  s$  t0,  (5) 

||Fo(£)7’0'1(£)||  ^  fa,  (6) 

||Fo(£Mo7’o",(£)II  <  M  (7) 

To(e)(A0  +  B0F0(e))T-\c)  =  J0(e),  (8) 

where  to,  fio  and  f)\  are  some  constants  independent 
oj  e  and  J0(s)  E  IRWoXW°  is  a  real  matrix.  Moreover , 
there  exists  a  Pq  >  0,  independent  oj  e ,  such  that 

Jq(8)Po  +  PqJo(^)  (9) 


and  a/’s  are  chosen  such  that 
/  4*  a rJ~l  4*  ar_i sr“2  H - 4  ot2s  +  <X\  =  (s  4-  1  )r, 


We  now  proceed  with  the  second  step  of  the  proof: 
to  show  that,  for  any  a  priori  given  bounded  set  C 
U2ny  there  exists  an  e*  €  (0, 1]  such  that,  for  each  e  E 
(0,  s*],  the  equilibrium  (x>  z)—(  0, 0)  of  the  closed-loop 
system  is  asymptotically  stable  with  SCq  contained  in 
its  domain  of  attraction.  Without  loss  of  generality, 
let  us  assume  that  the  system  is  already  in  the  form 
of  (3),  i.e.,  T  =  I.  Letting  e  =  jc  —  z,  we  can  write  the 
closed-loop  system  as  follows: 

*o  =A(pco  4*i?o*ii, 

*n  =xn, 

*12  =  *13, 


(11) 


*ir  =  Co(*o  _zo)  +  ai(*n  - z\i)  +  02(^12  ~zn) 

0t\ 

+ - (-  ar(X]r  -  Zir)  -  —(y  -  F0(e)z0) 

£r 

a  2  ar 

7ZTz\2 - - Z\ r, 

E*  1  £ 

z  =  4z  +  L(Cz  —  y)-\-B[-  Cqzq  —  a\Z\\ 


- arzlr  -  — ( y  -  Fo(e)zo) 

£r 


Step  3.  Let  L  be  such  that  A  +LC  is  Hurwitz.  Such 
an  L  exists  since  the  pair  (A,  C)  is  detectable. 

Step  4.  Construct  the  family  of  output  feedback 
laws  as  follows: 

z~Az  +  Bu  +  L(Cz  -  y\ 

r 

u  =  -C0Z0  -  ^2 atzu  -  -  Fo(fi)zo)  (10) 

i—  1 

a2  ar 

—  zl2 - -  zlr, 

£r  1  £ 

where  z0  and  z j,*,  /  =  1 , 2, . . . ,  r,  are  defined  as  follows: 
Z=Tz9  z=[z f  z[f,  Z\  —\Z\[  Z\2  •**  Zir]7, 


y  =  cr(xu). 

We  next  define  a  new  set  of  state  variables  as  follows: 
*0  =  T0(£)Xo, 

*11  -F0(e)xo, 

*i i  =  d  4  Cj_id  2x\i-\  4-  3*h_2  +  *  *  * 

+C;ifax12  +  CpjCx „  -  Fo(s)xo),  (12) 

i  =  2,3,...,r, 
eo=x0  -  z0y 

eu=xu~zu,  i—l,2,...,r. 
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and  denote 

e  =  [el  e\\  el2  elr]T. 

With  these  new  state  variables,  the  closed-loop  system 
can  be  written  as  follows: 

Xq  —  J0(e)xo  +  7o(£)^o^h> 


that  (x ,z)  e  %o  implies  that  (;to>*ib--*>*ir)  € 
Lv{c)-.=  {(xo,xn,...,x lr,e)  e  R2":  V  c}. 

Using  Lemma  1,  we  can  calculate  the  derivative  of 

V  inside  the  level  set  Ly(c)  along  the  trajectories  of 
the  closed-loop  system  (13)  as  follows: 

V  =  +  2vxIPqTo(£)B0xu 


*11  =  --*11  +  — *12  -  [Fo(fi>4oro  '(£) 

£  £ 

+Fo(e)B0Fo(£)7’0_  1  (£)]x0  -  F0(E)Baxu, 

in  =  --*12  +  — *13  -  [Fo(£Mo7o_I(e) 

£  £ 

+Fo(£)SoFo(£)ro-1(£)]fo  -  F0(£)5 0*11, 


:  (13) 

*lr—  1  =  — *lr— 1  +  — *lr  ~  [Fo^MoTTHs) 

£  £ 

+  Fo(e)2?oFo(£)7’o  '(fi)]*o  —  Fo(£)5oxn, 

Zlr  =  — *Ir  +  -[*11  -  ff(xn)]  -  7F0(£)e0 

£  £  £ 

+£r-,[Coeo  +  a\e\\  +  02^12  + - 1-  areu] 

+  «2en  +  *36^13  +  •  •  •  +  ocrer~2eir 

-lF0(e)A0ro-l(E)  +  Fo(£)B0F0(s)ro-\£)]xo 

-F0(E)Boxn, 

e  =  (A  +  LC)e  -  L[x  1 1  -  a{x\  1 )]. 

Choose  a  Lyapunov  ftmction  candidate  as  follows: 

r 

V(x0,xu,...  ,*1  r,  e)-vxlPox0+  53  x]j+\/ieTPe, 

i=l 

(14) 

where  v  6  (0, 1],  independent  of  £,  is  a  constant  whose 
value  is  to  be  determined  later,  Po  is  as  defined  in 
Lemma  1,  and  P  >  0  is  such  that 

(A  +  LC)rP  +  P(A  +  LC)  =  —I.  (15) 

Let  c  >  0,  independent  of  £,  be  such  that 

c  ft  sup  V(x0>xiu...,xir,e).  (16) 

(*t2)€3To,fie(<U],ve(o,i] 

Such  a  c  exists  due  to  the  boundedness  of  SPq 
and  the  definition  of  the  state  variables  as  given 
by  (12).  With  this  choice  of  c,  it  is  obvious 


+£ 


2  2 

•  -*i;+ -*l/*li+!  — 2*li[Fo(£Mo  Tq  1  (fi) 


+Fo(e)5oFo(fi)r0  ‘(e)]*o  -  2*i,Fo(s)BoXn 


—[*u  —  <r(*n)]  -  -F0(e)e0 
£  £ 


+  2Xjr 

-h£r  1  [Cq6 0  4*  +  * - h  dre\r\ 


+  ot2e\2  +  a3££?i3  H - \-  ccrsr  2eir 


—  y/eeT 


—2  y/eeTPL[x\i  —  cr(xn)] 


<  -vxlxo  +  25oiv||x0|||xii|  + 

i=l 


2 

+-*1.*H+1  +  25;0£|xi,|||fo||  +  2(5,i£|xi,||xn| 

£ 

2 

+  -|*ir||*u  -  0'(*n)|  +  2fji|xir|||e||  -  VeeTe 
+2ti2Ve\\e\\\xu -<r(*n)|,  (17) 

where  <5//s  and  rjj's  are  some  constants,  independent 
of  £. 

We  will  continue  our  evaluation  of  V  by  considering 
two  separated  cases,  |*n|  <  1  and  |jch|  >  L 
Case  1.  |xn  |  ^  1.  In  this  case,  we  have, 

V  <  —  vxJxq  +  2^oivll*o|||*ii  I 


1 

£ 

[*n 

*12 

•  •  *1  r— 

*lr] 

-  2 

-1 

...  o 

0  ■ 

‘  X\\ 

-1 

2 

...  o 

0 

*12 

X 

: 

*, 

; 

; 

0 

0 

•••  2 

-1 

Xlr-l 

.  0 

0 

...  _i 

2  . 

.  X\r  . 

r 

+  53  [2<5,o£|*i,i||*o||  +  2<5,[e|*i,||*n|] 
1=1 
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+2ijI|fir|||e||  -y/ie^e 


<- 


V 


INI2 


r 

+  53  +  <5/1  )«*?,•  +  5/oe|N|2  +  5/iexn] 

1=1 

+V\x2ir  +  (li  +m'fi)\\e\\2 


—  —  <50i  —  <5jo  -  2 S\\E  -  ( y:  )  g 


Vi=2 


X2 

*11 


r—  1 

-E 

1=2  L 


5l 


—  <5(0  -  5/i « 


l*u| 


5, 


-~srl>-24 } 

a  \/e  J 


|2 


where  we  have  used  the  fact  that  the  matrix 


"  2  -1  —  0  0“ 
2  •••  0  0 

0  0  2  -1 
_  0  0  •  •  -1  2„ 


(18) 


is  positive  definite  with  its  maximum  eigenvalue  de¬ 
noted  as  <5j  >  0. 

Let  v  be  such  that  v  <  l/2<5oi  and  let  e*  G  (0, 1]  be 
such  that  the  following  hold  for  all  s  G  (0,£*]: 

v  -  ^53  g2  -  ^oi  y2  ^ 


5, 

£ 


-  <5oi  “  <5io 


S  S 

—  —  5/o  —  5j/£  ^  /  =  2,3,. .  .,r  —  1, 

£  2e 


5, 


-5rle 


2tf 
yi  ^  2e 


(19) 


With  these  choices  of  v  and  £*,  we  conclude  that, 
for  any  |xn|  ^  1, 

v  <  -  jPof-lEi^f-^Ni2,  ee(o,£n. 


(20) 


Case  2.  |xh  |  >  1.  In  this  case,  we  have, 
V  <  -vx^xo  +  250iv||x0 |||fn| 

-\\?u  “(kill  -  l)2]-\/ieTe 


+  jj2\/fi(kii|  -  l)2-  (21) 

Now  let  £j  G  (0,1]  be  such  that,  for  all  e  G 
(O.fiJ]*  (xQ,x\U---,x\r,e)  G  Lv(c )  implies  that 

|^o(e>co|  < 

r 

2^oiv||xo|||fn|  +  ^2  K^°  ■*“  ^n)£*u  4*  <MM|2 
i=  1 

+*il£*ll]  +  *7l*lr  +  Oil  +  y2>fi)\\e\\2 

+  tl2>fe(\xn\  -  !)2  ^  (22) 

The  first  inequality  is  due  to  (4)  and  implies  that 

*11  -  (hi I-1)2  >  i  i 

With  this  choice  of  ej,  we  have  that,  for  any  |*n  |  >  1, 

V  <  -vxjx0  -  VleTe  -  e  G  (0,fij].  (23) 

Combining  Cases  1  and  2,  we  conclude  that,  for  any 
e  G  (0, £*]  with  £*  =  min{e*,£2}, 

V  <  0,  V(fo,fii,xi2s...,xu,e)  G  L^(c)\  {0}, 

(24) 


which,  in  turn,  shows  that  the  equilibrium  (x,z)=(0, 0) 
of  the  closed-loop  system  is  asymptotically  stable  with 
$T0  contained  in  its  domain  of  attraction.  □ 

In  what  follows,  we  will  use  a  simple  example  to 
demonstrate  the  closed-loop  system  behavior.  Con¬ 
sider  the  system  ( 1 )  with 


'0 

1 

0 

o' 

'o' 

'o' 

0 

0 

1 

0 

0 

1 

A  = 

0 

0 

0 

1 

,  5= 

0 

,  c  = 

0 

1 

0 

0 

0_ 

1 

0 

It  can  be  easily  verified  that  this  system  is  controllable 
and  observable  with  an  invariant  zero  at  s  =  0.  The 
open  loop  poles  are  located  at  {— 1,  ±j,  1}.  Following 
the  design  algorithm  we  proposed  above,  we  construct 
a  family  of  parameterized  output  feedback  laws  as 


output  y  states  X  and  z  output  y  states  x  and  z 
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follows: 

Z\=Zi-  2 (z2  -  j), 

i2  =  z3  -  4(z2  -  ^), 

^3  =  z4  ~  6(z2  —  _y),  ^25) 

z4  =  z,  -  4(z2  -  y)  +  u, 

1  3  3 

m  =  -z,  -  -r0>  +  ez  1)  -  “2^3  -  -z4. 

Some  simulation  results  are  shown  in  Figs.  1  and  2. 
In  the  simulation,  initial  conditions  are  taken  ran¬ 
domly  as  f  -  4.5625,  -18.8880,  8.2065,  -4.0685, 
34.5569,  15.4136,  -25.4760,  15.8338]T.  In  Fig.  1,  e 
is  chosen  to  be  e  =  0.1 .  It  is  clear  that  with  this  choice 
of  6,  the  initial  conditions  are  not  inside  the  domain 
of  attraction.  In  Fig.  2,  e  is  chosen  to  be  e  =  0.001.  It 
is  clear  that,  the  output  is  out  of  saturation  after  some 
time  and  the  closed-loop  system  become  linear  and 
all  its  states  converge  to  zero.  This  demonstrates  that 
as  e  decreases,  the  domain  of  attraction  is  enlarged. 
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In  general  of  course,  the  objective  is  to  have  a  short  test  interval. 
However,  there  is  a  tradeoff  between  the  separability  index  and  the 
>ngth  of  the  test  period.  As  we  have  seen,  7*  is  an  increasing  func¬ 
tion  of  T. 

VII.  Conclusion 

We  have  presented  a  methodology  for  error-free  system  identifica¬ 
tion  in  the  situation  where  we  have  two  candidate  linear  models  subject 
to  bounded  energy  noise,  and  where  we  have  control  over  the  input.  The 
problem  of  selecting  a  best  input  signal  over  a  test  period  (the  minimum 
proper  auxiliary  signal  design  problem)  has  been  solved  and  a  solution 
given  in  terms  of  the  solution  to  a  boundary  value  system.  The  solution 
of  this  boundary  value  system  also  enables  us  to  design  a  very  effi¬ 
cient  on-line  identification  scheme,  the  hyperplane  test,  that  takes  into 
account  the  fact  that  the  input  signal  over  the  test  period  is  known  in 
advance. 

A  related  problem  which  can  be  solved  with  the  methodology  pre¬ 
sented  here  is  the  shortest  test  period  problem  where  we  fix  the  separa¬ 
bility  index  and  look  for  the  shortest  test  period  for  perfect  identifica¬ 
tion.  The  procedure  is  similar  to  the  one  presented  in  this  paper,  except 
the  7-iteration  part  should  be  replaced  with  T -iteration. 

There  are  a  number  of  possible  extensions  to  the  work  presented 
here.  One  is  to  allow  for  additional  inputs  to  the  system,  i.e.,  the  models 
would  have  another  input  u,  in  addition  to  the  auxiliary  signal  u,  but 
this  one  measured  online,  just  like  the  output  y.  This  situation  has  been 
considered  in  [9]. 

Another  possible  extension  is  to  allow  for  some  nonlinearity.  In  par¬ 
ticular,  if  the  system  is  not  linear  in  v,  the  Kalman  filter  implementation 
d  the  hyperplane  test  still  apply.  The  problem  is  the  optimization  over 
An  approach  using  optimization  software  is  discussed  in  [3], 
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Exact  Characterization  of  Invariant  Ellipsoids  for  Single 
Input  Linear  Systems  Subject  to  Actuator  Saturation 

Tingshu  Hu  and  Zongli  Lin 

Abstract — We  present  a  necessary  and  sufficient  condition  for  an  ellip¬ 
soid  to  be  an  invariant  set  of  a  linear  system  under  a  saturated  linear  feed¬ 
back.  The  condition  is  given  in  terms  of  linear  matrix  inequalities  (LMIs) 
and  can  be  easily  used  for  optimization  based  analysis  and  design. 

Index  Terms — Actuator  saturation,  contractive  invariance,  invariant  el¬ 
lipsoid. 

I.  INTRODUCTION 

In  this  paper,  we  will  study  the  set  invariance  property  for  a  linear 
system  under  saturated  feedback 

x  —  Ax  +  Psat(F:c).  (1) 

We  will  be  interested  in  invariant  ellipsoids  due  to  the  popularity  of  the 
quadratic  Lyapunov  function  and  the  simplicity  of  the  results.  In  the 
literature,  invariant  ellipsoids  have  been  used  to  estimate  the  domain 
of  attraction  for  nonlinear  systems  (see,  e.g.,  [1] — [4],  [12]— [14],  [16], 
and  the  references  therein).  The  problem  of  estimating  the  domain  of 
attraction  for  (1)  has  been  a  focus  of  study  in  recent  years. 

For  a  matrix  F  £  Rm  Xn ,  denote  the  tth  row  of  F  as  /;  and  define 

C{F)  :=  {x£Kn:\fix\  <1,  2  =  1,  2, . . m} . 

If  F  is  a  feedback  gain  matrix,  then  C(F)  is  the  region  where  the  feed¬ 
back  controls  =  sat  (Ex)  is  linear  in  x.  We  call  C(F)  the  linear  region 
of  the  saturated  feedback  sat(Fx),  or  simply,  the  linear  region  of  sat¬ 
uration. 

Let  P  £  Rn  *  n  be  a  positive-definite  matrix.  For  a  positive  number 
p,  denote 

£(P,  p)  =  €  R":  xTPx  <  />}  . 

If 

(. A  +  BF)tP  +  P(A  +  BF)<  0 

and  £(P,  p )  C  £(F),  then  £(P,  p)  is  an  invariant  ellipsoid  inside  the 
domain  of  attraction.  The  largest  of  these  £(P,  p)s  was  used  as  an  es¬ 
timate  of  the  domain  of  attraction  in  the  earlier  literature  (see  e.g.,  [4], 
[15]).  This  estimation  method  is  simple,  yet  could  be  very  conserva¬ 
tive.  Recent  efforts  have  been  made  to  extend  the  ellipsoid  beyond  the 
linear  region  C{F)  (see,  e.g.,  [7],  [5],  [6],  [12],  and  [14]).  In  particular, 
simple  and  general  methods  have  been  derived  by  applying  the  abso¬ 
lute  stability  analysis  tools,  such  as  the  circle  and  Popov  criteria,  where 
the  saturation  is  treated  as  a  locally  sector  bounded  nonlinearity. 

More  recently,  we  developed  a  new  sufficient  condition  for  an  ellip¬ 
soid  to  be  invariant  in  [10]  (see  also  [8]).  It  was  shown  that  this  con¬ 
dition  is  less  conservative  than  the  existing  conditions  resulting  from 
the  circle  criterion  or  the  vertex  analysis.  The  most  important  feature 
of  this  new  condition  is  that  it  can  be  expressed  as  LMI’s  in  terms  of 
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all  the  varying  parameters  and  hence  can  easily  be  used  for  controller 
synthesis.  In  this  paper,  we  will  further  show  that  for  the  single  input 
)ase,  this  condition  is  also  necessaiy. 

Notation:  In  this  paper,  we  use  sat:  R  — »  R  to  denote  the  standard 
saturation  function,  i.e.,  sat(u)  =  sign(u)min{l,  |u|}. 

II.  Review  of  the  Existing  Results 

Consider  the  linear  system  with  a  single  saturating  input 

x  =  Ax  +  Bu,  x  €  Rn,  u  G  R,  |ujoo  <  1.  (2) 

Under  a  saturated  linear  feedback  u  =  sat (Px),  the  closed-loop 
system  is 


x  =  Ax  +  Bsat(Fx).  (3) 

Given  a  positive  definite  matrix  P,  let  V  (x)  =  xT  Px.  The  ellipsoid 
£(P,  p)  is  said  to  be  (contractively)  invariant  if 

V(x)  =  2xTP(Ax  +  Bsat(Fx))  <  (<)0 

for  all  x  £  £(P ,  p).\{0}.  Clearly,  if  £(P,  p)  is  contractively  invariant, 
then  it  is  inside  the  domain  of  attraction. 

A.  Conditions  for  Set  Invariance 

We  developed  a  sufficient  condition  for  set  invariance  in  [10]  (see 
also  [8])  for  multi-input  systems.  For  single  input  systems,  the  condi¬ 
tion  can  be  stated  as  follows. 

Theorem  1:  Consider  system  (3).  Given  an  ellipsoid  £(P ,  p),  sup¬ 
pose  that 

} 

( A  +  BF)7  P  +  P(A  +  BF)  <  0.  (4) 

If  there  exists  an  E  E  Rlxn  such  that 

(A  +  BH)rP  +  P(A  +  BH)<  0  (5) 

and  S(P,  p )  C  £{H),  i.e.,  \Ex\  <  1,  Vx  £  £(P,  p),  then  £(P,  p)  is 
a  contractively  invariant  set  and  hence  inside  the  domain  of  attraction. 

For  p  sufficiently  small,  we  always  have  £(P,  p)  C  £(F).Hence,(4) 
is  a  necessary  condition.  Before  determining  the  contractive  invariance 
of  an  ellipsoid  £  (P,  p),  it  is  necessary  to  make  sure  that  (4)  is  satisfied. 
Since  (5)  is  veiy  simple  and  easily  tractable,  it  is  desirable  that  (5)  is  also 
a  necessary  condition.  Although  we  will  finally  show  that  this  is  indeed 
the  case,  the  proof  of  the  necessity  is  much  more  involved  than  the  suffi¬ 
ciency.  We  have  to  approach  it  through  some  more  existing  results. 

In  [8],  we  obtained  a  necessary  and  sufficient  condition  for  set  in¬ 
variance. 

Theorem  2:  Given  an  ellipsoid  £  (P,  p)  and  an  F  ERIx",  suppose 
that 


(A  +  BF)rP  +  P(A  +  BF)  <  0.  (6) 

Then  £(P,  p)  is  contractively  invariant  under  u  =  sat(Px)  if  and 
only  if  there  exists  a  function  h(x):  Rn  — +  R,  |h(x)|  <  1  for  all 
x  £  £(P,  p),  such  that  £(P,  p)  is  contractively  invariant  under  the 
control  u  =  h(x),  i.e., 

xT P( Ax  +  Bh(x))  <0,  Vx  €  £(P,  p)  \  {0}.  (7) 

) 


B.  Existence  of  Control  Law  for  Set  Invariance 

The  condition  of  Theorem  2,  the  existence  of  h{x)  satisfying  (7), 
was  studied  in  [8],  [11].  The  results  are  summarized  as  follows. 

Fact  I:  The  following  two  statements  are  equivalent: 

a)  the  ellipsoid  £(P,  p)  can  be  made  contractively  invariant  for 

x  =  Ax  4-  Bu  (8) 

with  abounded  control  u  =  fc(x),  |h(x)|  <  1; 

b)  the  ellipsoid  £(P,  p)  is  contractively  invariant  for  (8)  under  the 
control  u  =  — sign(PTPx),  i.e.,  the  following  condition  is  sat¬ 
isfied, 

V{x)  =xt(AtP  +  PA)x  -  2zTPBsign(BTFz)  <  0, 

Vx  G  £(P ,  p)  \  {0}.  (9) 


For  an  arbitrary  P  >  0,  there  may  exist  no  p  >  0  such  that 
£(P,  p)  can  be  made  contractively  invariant  with  a  bounded  control 
u  —  h(x))  |h(x)|  <  1.  In  the  sequel,  we  simply  say  that  £(P,  p) 
can  be  made  contractively  invariant.  Let  P  be  given,  the  following 
proposition  gives  a  condition  for  the  existence  of  p  >  0  such  that 
£(P,  p)  can  be  made  contractively  invariant. 

Proposition  1:  For  a  given  positive  definite  matrix  P,  £(P,  p)  can 
be  made  contractively  invariant  for  some  p  >  0  if  and  only  if  there 
exists  a  k  >  0  such  that 

AtP  +  PA-  kPBBTP  <  0.  (10) 


Note  that  if  (10)  is  satisfied  for  k  =  ko,  then  it  is  satisfied  for  all 

k  >  ko. 

Theorem  3:  Given  P  >  0,  assume  that  £(P,  p)  can  be  made  con¬ 
tractively  invariant  for  some  p  >  0.  Now  we  consider  a  given  p.  Let 
Ai ,  A2,  . . . ,  Ay  >  0  be  real  numbers  such  that 
'A  jP-ArP-PA  P 


det 


p-^PFP'P 


XjP- 


A  P  —  PA 


=  0 


(ID 


and 

BrP(A7P  +  PA  -  A jP)~lPB  >  0.  (12) 

Then,  £(P,  p)  is  contractively  invariant  under  the  control  u  = 
—sign(PTPx)  if  and  only  if 

A jp  -  BtP(AtP  +  PA-  \jP)~l PB  <  0, 

Vi  =  1,2,...,  J.  (13) 

If  there  exists  no  A,  >  0  satisfying  (11)  and  (12),  then  £(P,  p)  is 
contractively  invariant. 

Here  we  note  that  all  the  Ays  satisfying  (1 1)  are  the  eigenvalues  of 
the  matrix  shown  at  the  bottom  of  the  page.  Hence  the  condition  of 
Theorem  3  can  be  easily  checked.  It  is  shown  in  [8]  and  [1 1]  that  there 
is  a  p*  >  0  such  that  £(P,  p)  is  contractively  invariant  if  and  only  if 
p  <  p*.  Therefore,  the  maximum  value  p*  can  be  obtained  by  checking 
the  condition  of  Theorem  3  using  a  bisection  method. 

For  the  single  input  case,  if  P  is  fixed,  then  we  can  combine  Theorems 
2  and  3  to  find  the  largest  p  such  that  £(P,  p)  is  invariant  under  a  given 
saturated  feedback  u  =  sat (Fx) .  However,  if  P  is  an  unknown  param¬ 
eter  for  optimization  (for  example,  in  the  design  problem  of  enlarging 
the  domain  of  attraction),  then  the  condition  of  Theorem  3  would  not  be 
easy  to  deal  with.  For  this  reason,  we  would  like  to  use  Theorem  1  since 
its  condition  leads  to  LMI  constraints  (see,  e.g.,  [2]).  The  only  concern  is 
that  we  might  not  find  the  optimal  invariant  ellipsoid  since  the  condition 
of  Theorem  1  was  only  shown  to  be  sufficient.  This  paper  is  intended  to 


-p-(l/2)^Tpl/2  +  pl/2^p-(l/2) 

_^-lpl/2£pTpl/2  p-(l/2)^Tpl/2  _j_  pl/2^p-(l/2) 
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close  this  gap.  We  will  show  in  the  next  section  that  for  the  single  input 
case,  the  condition  in  Theorem  1  is  also  necessary.  If  P  is  fixed,  then 
’^ie  largest  p  satisfying  the  condition  of  Theorem  1  is  the  same  as  the 
largest  p  satisfying  the  condition  of  Theorem  3. 

m.  Main  Results 

Theorem  4:  Given  an  ellipsoid  £(P,  p)  and  an  F  G  R1  Xn ,  assume 
that 


(A  +  BFfP  4  P(A  4  BF)  <  0. 


(14) 


Then  £(P,  p)  is  contractively  invariant  under  the  feedback  u  = 
sat(Fx)  if  and  only  if  there  exists  an  H  £  R1  x  ”  such  that 

(A  +  BH)tP  +  P(A  +  BE)  <  0  (15) 

and  £(P,  p)  C  C{E). 

Recall  from  [8],  [9],  £(P,  p)  C  C(H)  is  equivalent  to 

pHP~1H'T  <  1. 

Lemma  1:  Suppose  that  £(P,  p)  can  be  made  contractively 
invariant  for  some  p  >  0.  Let  p*  be  the  supremum  of  all  the  ps  such 
that£(P,  p)  is  contractively  invariant  under  u  =  -sign(PTPx)  (i.e., 
satisfying  the  conditions  in  Theorem  3).  Then  there  exists  a  A  >  0 
such  that 


det 


AP- ATP-P,4 
1 


L  P* 


•  PBBrP 


P 

A  P  -  AtP  -  PA 


=  0 


and 


Ap*  =  BtP(AtP  +  PA-  \P)~XPB. 


V{x)  =  xI(ArP  4  PA)x  -  2 xtPB  sign (B 1  Px). 


Let 


Define 


g(x)  =  xT(ATP  +  PA)x  -  2 xTPP. 


7 (p)  =  max  |g(x):  xTPx  =  p,  BTPx  >  Cl)  . 


and 


It  can  be  shown  with  algebraic  manipulation  (see  the  Appendix)  that 
(16)  is  equivalent  to 

BTP(ATP  +  PA  -  A P)_1P(ATP  a  PA-  A P)_1PPT  =  p*. 

(20) 

We  claim  that  only  “=”  is  possible  in  (19).  Otherwise,  if  we  let  x  = 
(ATP  4  PA-  A  P)-1  PB,  then  from  (20),  we  have  xTPx  =  p\  and 
from  (18),  we  have  Br  Px  >  0.  Thus 

g(x)  =xt(AtP  4  PA)x  -  2 xTPB 

=  AiTPa;  -  xTPB 

=  A p*  -  PtP(AtP  4  PA  -  A P)~XPB  >  0. 

This  means  that  t(p*)  >  0,  which  is  a  contradiction.  Therefore,  we 
must  have 

Ap*  -  BTP(ArP  +  PA  -  A Py1  PB  =  0. 

□ 

Lemma  2:  Suppose  that  £(P,  p)  can  be  made  contractively 
invariant  for  some  p  >  0.  Let  p*  be  defined  in  Lemma  1  with  A 
satisfying 

r  A P  -  AtP  -  PA  P 


det 


—  PBBrP  A P  -  ATP  -  PA 

P* 


=  0 


(16) 


(17) 


and 


Let 


\p*  =  BtP(AtP4PA-AP)_1PB. 


(21) 


(22) 


Proof:  Let  V(x)  =  xrPx.  Under  the  control  u  = 
—sign (BtPx),  the  derivative  of  V(x)  along  the  trajectory  of 
the  closed-loop  system  is 


Ho  =  -±-BtP{A^P  4  PA  -  AP)-1P 

then  p*PoP_1PoT  =  1,  i.e.,  <£(P,  p *)  C  C(H0)  and 
(A4M0)tP  +  P(A  +  BIo)  <  0. 


(23) 


It  is  shown  in  [8]  and  [11]  that  if  7 (p)  <  0,  then  7(^1)  <  0  for 
all  pi  G  (0,  p).  Hence,  £(P,  p)  is  contractively  invariant  under  u  = 
~sign(BTPa:)  if  and  only  if  t(p)  <  0.  Since  the  function  g(x)  is 
uniformly  continuous  on  any  compact  set,  7(p)  is  continuous  in  p.  By 
the  definition  of  p *,  we  have 

7 (P)  <0,  Vp  £  (0,  p*) 

and  7 (p*)  =  0.  It  is  clear  that  £(P,  p*)  is  invariant  but  not  contrac- 
)vely  invariant.  By  Theorem  3,  there  exists  a  A  >  0  satisfying  (16)  and 


Proof:  Since  £(P>  p)  can  be  made  contractively  invariant  for 
some  p  >  0,  by  Proposition  1,  there  exists  a  fco  >  0  such  that 

AtP  +  PA  -  kPBB^P  <  0  (24) 

for  all  k  >  ko. 

From  Fact  2  in  the  Appendix,  (21)  is  equivalent  to 

BtP(AtP  4  pa  -  A P)-1P(AtP  4  PA  -  AP)_1PP  =  / 

(25) 

it  follows  that  pmH0P~1Ho  =  1,  which  implies  that  £(P,  p")  C 

£(Po). 

We  next  proceed  to  prove  (23).  Consider  a  state  transformation  of 
the  form  z  =  Tx,  where 

for  some  unitary  matrix  U  G  Rnx",  PPT  =  I.  U  is  to  be  specified 
later.  Let 


PtP(AtP4PA-  \P)~lPB  >0  (18) 


Ap*- j3TP(ATP4PA-AP)_IPB>0.  (19) 


B=TB,  A  =  PAT-1 ,  P0  =  H0T~r 


and 


Q  =  At4A. 
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BT(Q  -  \I)~l(Q- 

_  /  p  \  l/2  _ 


+b{£)'/>,'(£)  "Wb'‘u)  bb 

(,(jrv(f)-v„(i) 

AS) . "•-)"<)” 


Also,  we  have 


From  (26)  and  (28),  we  have  H0Hq  =  1.  Recall  that 


P0  =  F0T‘ 


By  choosing  Z7,  we  can  make 

-ffo  =  Bt(Q  -  A/)"1  =  [1  01X(„_1)]  • 


for  all  k  >  k0.  That  is 

f  kp*\2  -  2A  (VA  -  1  )bj 


L(*p*A-l)62  ftp*626j-02J  ’ 

By  Schur  complements,  this  implies 

“  Q2  >  0, 


>  0,  Vk>  k0. 


kpmb2b J  -  Q2  -  ^f.AA2  &2&J  >0,  Vfc  >  fo. 
The  second  inequality  can  be  rewritten  as 


= bt  (Ly\P-^Pu> 

+ pi/2ap~(i/2)  -^y1 

•  (p-C1/2)^  pl/2 

+P1/2AP_(1/2) -A/)-1  '  B 

=  —BtP(AtP  +  PA-  A P)_1 
P’ 

■  P(ATP  +  PA-  XP)~lPB  =  1, 

y  where  the  last  “=”  follows  from  (25).  For  easy  reference,  we  rewrite 
I  lie  above  equation  as 

Bt(Q-XI)-\Q-M)-1B  =  1.  (26) 

Similarly,  from  (22),  we  obtain 

JB  T(Q  —  A/)-1B  =  A.  (27) 


Partition  B  and  Q  as  follows 
»-[£]■ «-[; 


«1  ?21 


LM1  U21  Q2  J  ’  ^ 

From  (29),  we  have 

PT=[1  0lx(n-l)]  (Q  ~  XI). 


&i>  Qi  €  R. 


It  follows  that: 


—  A  =  b  1,  <?21  =  &2- 


From  (27)  and  (29),  we  have  bi  =  A.  In  summary 

q=[2* 

I>r  L*a  02J 

Multiplying  (24)  from  left  with  (r~1)T  and  from  right  with  T"1, 
we  obtain 

Q-kp'BB*1  <0 


2A  6262  "  >  °- 

Since  this  inequality  is  true  for  all  k  >  k0 ,  we  must  have  Q2  <  0. 

Let’s  finally  examine  the  term  (A  +  jBJET0)tP  4*  P(A  +  BH0). 
Recall  that  in  the  new  coordinate 

Jo  as  -  [l  0lx(n-a)] . 

Hence 

d+W+3+Sff.-0-[“  f]-[J  °J<0 

which  is  equivalent  to 

(T^fiA  +  BH0)Tt  +  T(A  +  PPo)T_1  <  0. 

Multiplying  both  sides  from  left  with  Tt  and  from  right  with  T,  we 
have 

(A  +  BHo)TrT  +  TtT(A  +  BH0)  <  0. 

Noting  that  TtT  =  P/p* ,  we  finally  obtain  (23).  □ 

Proof  of  Theorem  4:  The  sufficiency  follows  from  Theorem  1. 
Now  we  prove  the  necessity.  That  is,  suppose  that  £(P,  p)  is  contrac- 
tively  invariant,  then  there  exists  an  E  E  Rlxn  such  that 

(A  +  BfffP  +  P(A  +  BH)  <  0 

and  £{P,  p)  C  C(H). 

.  Here,  we  have 

(A  +  BF)tP  +  P(A  +  BF)  <  0. 

Define  H(a)  =  (1  -  a)  Ho  +  aF,  where  Ho  is  defined  in  Lemma  2. 
It  follows  from  (23)  in  Lemma  2  that: 

(A  +  BH(a)fP  +  P(A  +  BH(a:))<  0  (30) 

for  all  a  6  (0, 1].  Also  from  Lemma  2 

pmH0P~lHj  =  1. 

Since  £(P,  p)  is  contractively  invariant,  we  must  have  p  <  p*.  It  fol¬ 
lows  that: 

pHoP-'Hj  <  1. 

Since  Ho  =  H( 0),  by  the  continuity  of  H(a),  there  exists  a  suffi¬ 
ciently  small  a  >  0  such  that 

pH{a)P~lH{cc)T  <1  (31) 

i.e.,  £(P,  p)  C  £{H(a)).  This  completes  the  proof  by  observing  (30) 
and  letting  H  =  H(a).  □ 

The  results  in  Theorems  2  and  4  and  Fact  1  can  be  summarized  in 
the  following  proposition. 

Proposition  2:  Given  a  P  >  0,  assume  that  £(P,  p)  can  be  made 
contractively  invariant  for  some  p  >  0.  Let  p  >  0  be  given.  The  fol¬ 
lowing  statements  are  equivalent: 
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"1 


det(p  -  PB)  =  0 

t 

p 

-$_1  PB  P-1 


det 


=  0 


det  j 


( 

P  0  ' 

1  \BtP  0] 

-#-1 

0  ' 

'  0 

r 

\ 

V 

0  P~\ 

o 

_ 1 

1 

0 

PB 

0, 

) 

det 


( r 

O' 

'  0 

I' 

[p-1 

0] 

\btp  01\ 

Uo 

PB 

0. 

.  0 

p  J 

0  iJJ 

det 


t 

XP  —  ArP  —  PA  P 

p~1PBBrP  XP-AtP-PA\ 


=  0. 


a)  £(P,  p)  can  be  made  contractively  invariant  with  some  u  = 
h(x),  |/i(x)|  <  1; 

b)  £ (P,  p)  is  contractively  invariant  under  the  control 
u  =  —  sign(Br  Px); 

c)  £(P,  p)  is  contractively  invariant  under  u  =  sat (Fx),  where  F 
satisfies 

{A  +  BF)rP+P(A  +  BF)<  0;  (32) 

d)  there  exists  H  £Rlx"  satisfying 
(A  +  BEfP  +  P(A  +  BH)  <  0 

and  S(P,p)  C  C(H). 

The  equivalence  results  in  Proposition  2  are  somewhat  counter  intu¬ 
itive.  Condition  a)  seems  to  be  the  weakest  and  condition  d)  seems  to 
be  the  strongest  Yet  they  are  all  equal.  The  equivalence  of  a)  and  d) 
implies  that  if  an  ellipsoid  can  be  made  contractively  invariant  with  a 
control  u  =  h(x ),  |7i(ar)|  <  1,  then  there  exists  a  control  law  linear  in 
x  in  the  ellipsoid  to  make  it  contractively  invariant. 

Of  the  four  statements  in  Proposition  2,  b)  can  be  checked  with  The¬ 
orem  3  but  there  is  no  direct  method  to  check  c).  The  last  condition  d) 
is  the  most  easily  tractable  and  can  be  flexibly  incorporated  into  anal¬ 
ysis  and  design  problems  such  as  estimation  of  the  domain  of  attraction 
and  enlarging  the  domain  of  attraction  (see  [8]-[l  0]).  It  can  also  be  ex¬ 
tended  for  the  purpose  of  disturbance  rejection  (see  [8],  [10]). 

Let  us  illustrate  the  application  of  Proposition  2  with  the  following 
example.  Suppose  that  we  are  given  a  shape  reference  set  Xr.  We  want 
to  design  a  controller  u  =  sat {f(x))  such  that  the  scaled  reference 
set  aXn  is  inside  some  invariant  ellipsoid  £(P ,  p)  of  the  closed-loop 
system 

x  =  Ax  +  J3sat(/(x)). 

The  objective  is  to  maximize  the  quantity  a  with  design  parameters  P, 
p  and  the  control  law  u  -  sat(/(x)).  This  problem  can  be  referred 
to  as  one  of  enlarging  the  domain  of  attraction  as  in  [9].  In  [9],  we 
restricted  the  control  law  to  be  linear  in  the  ellipsoid  £(P,  p).  That  is, 
u  =  sat(Px)  and  \Fx\  <  1  for  all  x  G  £(P \  p),  which  is  equivalent 
to  £(P ,  p)  C  £(P).  In  view  of  Proposition  2,  this  restriction  to  linear 
control  law  will  not  affect  the  resulting  maximal  value  of  a.  The  great 
advantage  of  the  restriction  is  that  the  optimization  problem  can  be 
Jasily  solved  with  LMI  technique  (see  [8]  and  [9]). 

IV.  Conclusion 

This  paper  presents  a  complete  characterization  of  invariant  ellip¬ 
soids  for  a  single  input  linear  system  subject  to  actuator  saturation.  In 


particular,  we  obtained  several  equivalent  conditions  for  an  ellipsoid  to 
be  invariant  under  a  certain  saturated  linear  feedback.  One  of  the  con¬ 
dition  is  stated  in  terms  of  linear  matrix  inequality,  which  can  be  easily 
used  for  stability  analysis  and  controller  design. 

Appendix 

An  Algebraic  Fact 

Fact  2:  Assume  that  P  and  (A P  -  ATP  -  PA)  are  nonsingular, 
then 

.  JXP-A^P-PA  P  1 

det[  p~1PBBTP  xp-atp-pa\  0  (33) 

is  equivalent  to 

BTP(ATP  +  PA-\P)-1P(ArP+PA-XPr1PB  =  p.  (34) 
Proof:  Denote 

$  =  XP  -  ArP  -  PA, 
then  the  equation  (34)  can  be  written  as 


b7p$-1p$-1pb  =  p. 

(35) 

By  invoking  the  equalities 

det 

' X ! 
Xz 

=  det^Odet^-  XzXr'Xz) 

(36) 

and 

det 

Xz 

*2  j  =  det(X,)det(X,  -  XzX^Xz) 

(37) 

we  see  that  (35)  is  equivalent  to  the  equations  shown  at  the  top  of  the 
page.  The  last  equation  is  (33). 
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Solving  a  Nonlinear  Output  Regulation  Problem:  Zero 
Miss  Distance  of  Pure  PNG 

Jae-Hyuk  Oh 


Abstract—? This  note  presents  a  solution  to  the  output  regulation  problem 
of  a  nonlinear  system  with  time-varying  disturbance:  the  system  represents 
the  well-known  missile-target  pursuit  situation  where  the  missile  is  guided 
by  the  pure  proportional  navigation  guidance  (PPNG)  law  while  the  target 
maneuvers  with  time-varying  normal  acceleration,  and  the  problem  is  to 
prove  the  zero  miss  distance  property  of  PPNG,  which  has  been  studied 
for  decades  without  satisfactory  success.  To  solve  this  problem,  we  con¬ 
struct  a  function  by  which  a  time  sequence  of  the  missile-to-target  range 
is  upper-bounded,  and  prove  that  the  function  is  strictly  decreasing,  which 
is  also  proven  to  guarantee  that  there  is  always  a  subsequence  that  asymp¬ 
totically  converges  to  zero.  The  solution  is  given  in  the  form  of  a  necessary 
and  sufficient  condition  guaranteeing  zero  miss  distance  of  PPNG. 

Index  Terms — Nonlinear  output  regulation,  pure  proportional  naviga¬ 
tion  guidance  (PPNG),  time-varying  disturbance,  zero  miss  distance. 


Nomenclature 

Vm(vt)  Missile  (target)  speed. 

am  (at )  Missile  (target)  acceleration. 

8 l  Euler  angle  from  reference  coordinate  system  to  LOS  co¬ 

ordinate  system. 

8m  Euler  angle  from  LOS  coordinate  system  to  missile  body 

coordinate  system. 
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St 

Euler  angle  from  LOS  coordinate  system  to  target  body 
coordinate  system. 

N 

Navigation  constant 

r 

Missile-to-target  range. 

P 

vt/vm. 

$8i)  c8i 

sin  8i ,  cos0i. 

a.e. 

almost  everywhere . 

I.  Introduction 

The  pure  proportional  navigation  guidance  (PPNG)  law  has  been 
widely  adopted  in  many  tactical  missile  systems  because  of  its  sim¬ 
plicity  and  high  capturability,  which  has  been  proven  in  practice.  As  a 
consequence,  a  lot  of  research  has  been  carried  out  to  confirm  mathe¬ 
matically  the  high  capturability  of  the  PPNG  [l]-[6]. 

Specifically,  it  has  been  shown  in  [2],  and  [4 ]-[6]  that  a  missile 
guided  by  PPNG  can  always  intercept  a  target,  which  is  maneuvering 
with  time-varying  normal  acceleration,  under  some  conditions  on 
the  navigation  constant,  the  initial  heading  error,  the  initial  mis- 
sile-to -target  range,  the  magnitude  of  target  acceleration,  and  the  ratio 
of  missile  speed  to  target  speed.  These  conditions  are  equivalent  to  the 
conditions  for  the  missile-to-target  range  to  be  strictly  decreasing  after 
a  finite  time.  In  other  words,  the  prior  research  excludes  the  case  when 
the  missile-to-target  range  has  a  fluctuating  time-profile  caused  by  the 
target  maneuver.  This  exclusion  results  in  significant  discrepancies 
between  the  mathematical  analysis  results  and  the  actual  capturability 
of  the  PPNG. 

In  fact,  it  is  quite  challenging  to  mathematically  analyze  the  captura¬ 
bility  of  PPNG  for  the  case  when  the  missile-to-target  range  is  doomed 
to  fluctuate.  Interestingly,  the  problem  that  we  are  dealing  with  can 
be  viewed  as  an  output  regulation  problem  of  a  nonlinear  system  with 
time- varying  perturbations:  the  nonlinear  system  is  the  missile-target 
pursuit  dynamics,  the  feedback  controller  is  the  PPNG  law,  the  output 
is  the  missile-to-target  range,  and  the  perturbation  is  the  time-varying 
normal  acceleration  of  the  target.  However,  since  our  output  zeroing 
manifold  does  not  contain  any  equilibrium  points,  it  is  impossible  to 
directly  apply  the  results  of  earlier  research  [7]— [1 1]  to  this  problem. 

This  note  describes  the  construction  of  an  asymptotic  time-function 
by  which  the  missile-to-target  range  is  always  upper-bounded.  This  ap¬ 
proach  can  provide  a  necessary  and  sufficient  condition  under  which  a 
missile,  which  is  launched  toward  the  target  with  p  <  1  and  guided  by 
the  PPNG  law,  can  always  capture  a  target  maneuvering  arbitrarily  with 
time- varying  normal  acceleration.  Specifically,  it  is  shown  that  a  navi¬ 
gation  constant  larger  than  1  is  the  only  condition  required  to  achieve 
zero  miss  distance.  In  our  analysis,  the  nonlinear  dynamics  of  pursuit 
situations  are  taken  into  full  account. 

II.  Preliminaries 

The  two-dimensional  (2-D)  pursuit  situation  can  be  represented  as 
follows  [2],  [4]: 


r  =  ( pcBt  -  c9m)vm 

(1) 

L  =  —  -  0L 

Vm 

(2) 

6i  =  -  -  6l 

Vt 

(3) 

where  am,  missile  acceleration  generated  by  the  PPNG,  and  6l,  LOS 
rate,  are  given  by 

ql  =  (psftt  ~  s8m)vm  ^ 

dm  -  Nvm8L.  (5) 
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Abstract 

We  present  a  method  to  estimate  the  domain  of  attraction  for  a  discrete-time  linear  system  under  a  saturated  linear 
feedback.  A  simple  condition  is  derived  in  terms  of  an  auxiliary  feedback  matrix  for  determining  if  a  given  ellipsoid  is 
contractively  invariant.  Moreover,  the  condition  can  be  expressed  as  linear  matrix  inequalities  (LMIs)  in  terms  of  all  the 
varying  parameters  and  hence  can  easily  be  used  for  controller  synthesis.  The  following  surprising  result  is  revealed  for 
systems  with  single  input:  suppose  that  an  ellipsoid  is  made  invariant  with  a  linear  feedback,  then  it  is  invariant  under  the 
saturated  linear  feedback  if  and  only  if  there  exists  a  saturated  (nonlinear)  feedback  which  makes  the  ellipsoid  invariant. 
Finally,  the  set  invariance  condition  is  extended  to  determine  invariant  sets  for  systems  with  persistent  disturbances.  LMI 
based  methods  are  developed  for  constructing  feedback  laws  that  achieve  disturbance  rejection  with  guaranteed  stability 
requirements.  ©  2002  Elsevier  Science  B.V.  All  rights  reserved. 


Keywords:  Actuator  saturation;  Stability  analysis;  Disturbance  rejection;  Set  invariance 


1.  Introduction 

In  this  paper,  we  are  interested  in  the  control  of  linear  systems  subject  to  actuator  saturation  and  persistent 
disturbances, 

x(k  +  1 )  =  Ax(k)  +  2?sat(tt(£))  +  Ew(k),  xeUn,  uC  Rm,  w  €  Uq,  (1) 

where  x  is  the  state,  u  is  the  control,  w  is  the  disturbance  and  sat(-)  is  the  standard  saturation  function.  First, 
we  will  consider  the  closed-loop  stability  under  a  given  linear  state  feedback  u~Fx  in  the  absence  of  the 
disturbance.  There  has  been  a  lot  of  work  on  this  topic  (see,  e.g.  [3-5,9-14]  and  the  references  therein).  For 
the  continuous-time  case,  various  simple  and  general  methods  for  estimating  the  domain  of  attraction  have 
been  developed  by  applying  the  absolute  stability  analysis  tools,  such  as  the  circle  and  Popov  criteria  (see,  e.g. 
[5,9,10,12],  where  the  saturation  is  treated  as  a  locally  sector  bounded  nonlinearity  and  the  domain  of  attraction 
is  estimated  by  use  of  quadratic  and  Lur’e  type  Lyapunov  functions).  The  multivariable  circle  criterion  in  [9] 
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was  restated  in  [12],  in  terms  of  (nonlinear)  matrix  inequalities  in  controller  parameters  and  other  auxiliary 
optimization  parameters,  such  as  the  positive  definite  matrix  P  in  the  Lyapunov  function  V(x)—xTPx  and 
the  saturation  levels.  By  fixing  some  of  the  parameters,  these  matrix  inequalities  simplify  to  linear  matrix 
inequalities  (LMIs)  and  can  be  treated  with  the  LM  software.  A  nice  feature  of  these  analysis  tools  is  that 
they  can  be  adapted  for  controller  synthesis  by  simply  considering  the  feedback  gain  matrix  as  an  additional 
optimization  parameter. 

In  [8],  a  simpler  criterion  is  derived  in  terms  of  an  auxiliary  feedback  matrix  for  determining  if  a  given 
ellipsoid  is  contractively  invariant  under  a  given  feedback  law.  This  condition  is  shown  to  be  less  conservative 
than  the  existing  conditions  which  are  based  on  the  circle  criterion  or  the  vertex  analysis.  The  most  important 
feature  of  this  new  condition  is  that  it  can  be  expressed  as  LMIs  in  terms  of  all  the  varying  parameters  and 
hence  can  easily  be  used  for  controller  synthesis. 

In  this  paper,  the  set  invariance  criterion  in  [8]  will  be  extended  to  discrete-time  systems  although  the 
approach  has  to  be  quite  different.  In  [8],  the  set  invariance  criterion  is  proven  by  expanding  the  derivative 
of  die  Lyapunov  function  and  examining  the  terms  that  include  the  saturated  feedback  sat(Fx).  However,  for 
the  discrete-time  case,  the  terms  of  the  increment  of  the  Lyapunov  function  cannot  be  examined  separately. 
A  new  approach  by  placing  the  saturated  control  sat(Fc)  in  the  convex  hull  of  a  group  of  linear  controls  is 
derived  to  establish  the  main  results.  By  further  exploiting  the  idea,  we  will  reveal  a  surprising  fact  for  the 
single  input  systems:  Given  a  feedback  matrix  F,  assume  that  an  ellipsoid  is  invariant  for  the  linear  system 

x(k  +  l)=Ax(k)  +  BFx(k). 

Then,  it  is  invariant  for  the  system 

x(k  +  1 )  =Ax(k)  +  Bsat(Fx(k)) 

if  and  only  if  there  exists  a  feedback  law  u  =  h(x),  |/i(x)|  s$  1,  such  that  the  ellipsoid  is  invariant  for  the 
system 

x(k+l)=Ax(k)  +  Bh(x(k)). 

This  means  that  the  set  invariance  property  under  a  group  of  saturated  linear  feedback  laws  is  in  some  sense 
independent  of  a  particular  feedback  in  this  group  as  long  as  all  the  corresponding  linear  feedback  laws  make 
the  ellipsoid  invariant. 

Based  on  the  stability  analysis  result,  some  disturbance  rejection  problems  will  be  considered,  such  as, 
set  invariance  property  in  the  presence  of  disturbance,  invariant  set  enlargement,  disturbance  rejection  and 
disturbance  rejection  with  guaranteed  stability  region. 

This  paper  is  organized  as  follows.  Section  2  addresses  the  analysis  of  and  design  for  closed-loop  stability. 
Section  3  addresses  the  issues  related  to  disturbance  rejection.  In  particular,  Section  2.1  presents  conditions 
for  an  ellipsoid  to  be  invariant.  Section  2.2  derives  a  necessary  and  sufficient  condition  for  an  ellipsoid  to  be 
invariant  in  the  case  of  single  input.  Section  2.3  proposes  an  optimization  approach  to  estimating  the  domain 
of  attraction.  Section  2.4  presents  a  controller  design  approach  to  enlarging  the  domain  of  attraction.  A  brief 
concluding  remark  is  given  in  Section  4. 


2.  Estimation  of  the  domain  of  attraction 

2. 1.  Condition  for  set  invariance  —  multiple  input  case 
Consider  the  open-loop  system 

x(k  +  \)=Ax{k)  +  Bsat(u(k)),  x€Un,  u <E  Rm,  (2) 

where  sat(-)  is  the  standard  saturation  function  of  appropriate  dimensions.  In  the  above  system,  sat :  IRm  — >  fRm, 
and  sat(«)  =  [sat(«i ), sat(w2 ),..., sat(Hm )]T,  where  sat(w,)  =  sgn(n,)min{l, |w,|}.  Here  we  have  slightly  abused 
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the  notation  by  using  sat(-)  to  denote  both  the  scalar  valued  and  the  vector  valued  saturation  functions.  Suppose 
that  a  state  feedback  u  =  Fx  has  been  designed  such  that  A  A-BF  is  Schur  stable  and  that  the  closed-loop  linear 
system  satisfies  some  performance  requirement.  We  would  like  to  know  how  the  closed-loop  system  behaves 
in  the  presence  of  saturation  nonlinearity,  in  particular,  to  what  extent  the  stability  is  preserved.  Our  first 
objective  of  this  paper  is  to  obtain  an  estimate  of  the  domain  of  attraction  of  the  origin  for  the  closed-loop 
system 

x(k  +  l)=Ax(k)  +  Bsat{Fx(k)).  (3) 

For  a  matrix  F  €  RmX",  denote  the  y'th  row  of  F  as  fj  and  define 
X(F):={x  e  R":  \fjx\  1,  j  €  [1, m]}. 

If  F  is  the  feedback  matrix,  then  if(F)  is  the  region  where  the  feedback  control  u  =  sat  (Fx)  is  linear  in  x. 

For  x(0)=i'o  £  R",  denote  the  state  trajectory  of  the  system  (3)  as  \j/(k,xo).  The  domain  of  attraction  of 
the  origin  is 

^ Xq  €  R":  lim  \l/(k,x0)  =  0^  . 

k—>  oo 

A  set  is  said  to  be  invariant  if  all  the  trajectories  starting  from  it  will  remain  in  it. 

Let  P  e  R”x"  be  a  positive-definite  matrix.  For  p  >  0,  denote 

£(P,  p)  =  {x€  R”:  xTPx  <  p}. 

Let  V(x)=xrPx.  The  set  £(P,p)  is  said  to  be  contractively  invariant  if 

AV(x):=(Ax  +  Bsat(Fx))TP(Ax  +  Bsat(Fx))  - xTPx  <  0 

for  all  x  €  <?(P,p)\{0}.  Clearly,  if  £(P,  p)  is  contractively  invariant,  then  it  is  inside  the  domain  of  attraction. 

We  will  develop  conditions  under  which  S{P,p)  is  contractively  invariant  and  thus  obtain  an  estimate  of 
the  domain  of  attraction. 

Let  9  be  the  set  of  m  x  m  diagonal  matrices  whose  diagonal  elements  are  either  1  or  0.  There  are  2m 
elements  in  2>.  Suppose  that  each  element  of  9  is  labeled  as  D,,  i  =  1,2,.. .,2'".  Then,  9  =  {Dp  i€[l,2m]}. 
Denote  D~  =7  -  Dt.  Clearly,  D~  is  also  an  element  of  9  if  Dt  €  9.  Given  two  vectors,  u,v€  Rm,  {Dtu  + 
D~v:  ie  [l,2m]}  is  the  set  of  vectors  formed  by  choosing  some  elements  from  u  and  the  remaining  from  v. 
Given  two  matrices  F,H  €  Rmxn,  {D,F  +  D~H\  i  €  [l,2m]}  is  the  set  of  matrices  formed  by  choosing  some 
rows  from  F  and  the  remaining  from  H. 

With  these  Z),  and  D~  matrices,  a  discrete-time  counterpart  of  Theorem  10.4  in  [9]  (when  applied  to 
saturation  nonlinearities)  can  be  derived  with  some  standard  technique  in  robustness  analysis  for  systems  with 
varying  parameters. 

Proposition  1.  Given  an  ellipsoid  £(P,p),  if  there  exists  a  positive  diagonal  matrix  K  £  RmXm,  K  <1  such 
that 

( A  +  BiPiF  +  D~KF))rP(A  +  B{DtF  +  D~KF ))  -P  <  0,  Vi 6 [1, 2m],  (4) 

and  £(P,p)  C  KF ),  then  £(P,p)  is  a  contractively  invariant  set. 

Here,  the  varying  gain  of  each  control  channel  (due  to  saturation)  is  viewed  as  an  uncertain  parameter 
varying  between  Ku  and  1,  and  the  quadratic  stability  (within  £(P,pj)  of  the  systems  corresponding  to  this 
box  of  uncertain  parameters  is  guaranteed  by  those  on  the  vertices  of  the  box,  {D,F  +  Dt  KF:  i  6  [1,2”]}. 
Similar  to  [8],  we  have  the  following  less  conservative  criterion  for  an  ellipsoid  to  be  contractively  invariant. 
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Theorem  1.  Given  an  ellipsoid  £(P,p),  if  there  exists  an  H  €  RmXn  such  that 
(. A  +  BiPiF  +  D~H))tP(A  +  B{DjF  +  D~H ))  -  P  <  0,  Vi  e  [l,2ffl], 
and  <£(P,p)  C  ¥(H),  then  £{P,p)  is  a  contractively  invariant  set. 

Although  a  natural  discrete-time  counterpart  of  Theorem  1  in  [8],  the  above  theorem  cannot  he  proven  in 
a  similar  way.  Before  starting  the  proof  of  Theorem  1 ,  we  need  some  simple  facts  about  the  convex  hull  of 
a  set  of  points.  Recall  that  for  a  group  of  points,  u\u2,. .  ..u^ ,  the  convex  hull  of  these  points  is  defined  as, 

(  s  >  'I 

co{wl:  i  €  [1, «/]}:—  V*  a,j/:  V  a,  =  1,  a,  >  0  . 


(5) 


i=i  i=i 


Lemma 

then 


1.  Let  u,  ul ,  h2,  . . . ,  i/  €  Rmi ,  v,  v' ,  v1, . . . ,  t/  €  Rm2 .  IJ  u  £  co{td :  i  €  [1 ,  }  and  v  €  co^ :  j  €  [1,  /] }, 

(6) 


m  rivi  i 

€co  . 
v  ty 


Proof.  Since  u  Eco{i/:  i  e[l,  J]}  and  v  €co{iV:  ye  [1,  /]},  there  exist  a„  fa  0,  i= 
j=  such  that 


J  /  J  / 

T  a,-  =  V'  Pj=  1,  u  =  Y^a,w',  v=^T‘fSjvi. 


i=l 

;=i 

i=l  7=1 

Therefore, 

M_ 

,i 

>  m 

f  jr  /  1 

V  «,«■'(' TjSy) 

r  >  /  1 

1  V  V  CCifijU* 

1=1 

1=1  7=1 

1=1  7=1 

u 

/ 

/  ✓ 

✓  / 

V  pjvJCT  «,) 

V  V'  OLipjVJ 
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Noting  that 

>  / 
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J 

—  ?  >  CtiPj  . 
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i=i  y=i 


1=1  y=l 


we  obtain  (6).  □ 
Lemma  2.  Ler  u,v£  Rm, 


’«1  ’ 

"th  ’ 

W  = 

u2 

,  »= 

* 

• 

_wm_ 

Suppose  that  \vj\  <  1  /or  a//  7  e 

sat(u)  €  co {DiU  +  u:  i  £  [1, 2m]}. 


Proof.  Since  \vj\  <  1,  we  have 

sat(wy)  £  co {Uj,  Vj}3  V/  €  [1,  w]. 
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Fig.  1.  Illustration  for  Lemma  2. 


By  applying  Lemma  1  inductively,  we  have 
sat(«i)€co{Mi,t>i}, 


sat 
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mv\m 

mv\m 
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ec° 
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* 
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.y3_ 

and  finally, 

sat(w)  €  co{A*w  +  Ary:  □ 

Lemma  2  is  illustrated  in  Fig.  1  for  the  case  where  m  —  2. 

Given  two  feedback  matrices  F9H  €  RmXn,  suppose  that  \hjx\  ^  1  for  all  j 6  [l,m],  then  by  Lemma  2,  we 
have 

sat(F;c)  €  co{DiFx  +  D~Hx:  i  G  [l,2m]}. 

In  this  way,  we  have  placed  sat(Fjc)  into  the  convex  hull  of  a  group  of  linear  feedbacks. 

Proof  of  Theorem  1.  Let  V(x)=xrPx,  we  need  to  show  that 

AV(x)  =  (Ax  +  Bsat(Fx))rP(Ax  +  Bszt(Fx))  -  xTPx  <0,  Vx  €  S(P, p)\{ 0}.  (7) 

Since  &(P,p)  C  SF(H),  i.e.,  \hjx\  <  1  for  all  j€  [1,  m]  and  x  €  S(P,p),  by  Lemma  2,  for  every  x  e  S(P,p), 
sat(Fx)  €  co{AFx  +  D~Hx\  i  €  [1, 2m]}. 

It  follows  that 

Ax  +  Bsal(Fx)  e  co {Ax  +  B(DjF  +  D~H)x:  i  €  [1, 2m]}. 


102 


T.  Hu  et  all  Systems  &  Control  Letters  45  (2002)  97-112 


By  the  convexity  of  the  function  V(z)  =  zTPz,  we  have 

(Ax  +  Bsa.t(Fx))TP(Ax  +  Psat(Px))  <  ma  x  1(A  +  B(D(F  +  DJH))TP(A  +  B(D{F  4-  D~H))x 

for  eveiy  x£  <?(P,  p).  Since  condition  (5)  is  satisfied,  we  have 

.  max  jctC^  +  B(DiF  +  D~H))rP(A  +  B(DtF  +  D~H))x  <  xTPx 

for  all  x  ^  0.  Therefore,  for  every  x  £  S(P,  p)\{ 0}, 

(Ax  +  Bsai(Fx))J P(Ax  4-  Bsat(Fx))  <  xTPx. 

This  verifies  (7).  □ 

We  see  that  Proposition  1  is  a  special  case  of  Theorem  1  by  setting  H  —  KF.  Clearly  the  condition  in 
Theorem  1  is  less  conservative  than  that  in  Proposition  1.  This  will  be  illustrated  in  Example  1.  Another 
important  advantage  of  Theorem  1  is  that,  when  optimization  is  concerned,  it  leads  to  constraints  in  the  form 
of  linear  matrix  inequality  while  from  Proposition  1  we  can  only  get  bilinear  matrix  inequalities.  This  will  be 
investigated  later. 

2.2.  The  necessary  and  sufficient  condition  —  single  input  case 

For  the  single  input  case  (m  —  1),  =  {0, 1}.  So  the  condition  in  Theorem  1  for  S(P,p)  to  be  contractively 

invariant  simplifies  to:  there  exists  an  H  £  Rlx”  such  that 

(A  +  BF)rP(A  +  BF) -P  <  0,  (A  +BH)rP(A  +BH)-P<  0 

and  £(Pyp)£<P(H).  In  fact,  we  can  go  one  step  further  to  obtain  the  following  surprising  result. 

Theorem  2.  Assume  m=  1.  Given  an  ellipsoid  <o(P,p),  suppose  that 

(A  +  BF)rP(A  +BF)-P<  0.  (8) 

Then,  is  contractively  invariant  under  u  =  sat(Fx)  if  and  only  if  there  exists  a  function  h(x):Um  — > 

R,  \h(x)\  ^  1  for  all  x£S(P,p\  such  that  &(P>p)  is  contractively  invariant  under  the  control  u  =  h(x),  i.e ., 

(Ax  +  Bh(x))rP(Ax  +  Bh(x))  -  xTPx  <0,  Vx  £  S{P,  p)  \  {0}.  (9) 

Proof.  The  “only  if’  part  is  obvious.  Now  we  show  the  “if’  part.  Here  we  have  |A(x)|  ^  1  for  all  x  £  S(P ,  p). 
It  follows  from  Lemma  2  that  for  every  x£&(P,p),  sat(Fx)  £  co{Fx,/z(x)}. 

By  the  convexity  of  the  function  V(z)  —  ziPzy  we  have 

(Ax  +  BsqX(Fx))tP(Ax  +  BsbX(Fx))  <  max{xT(^  4-  BF)JP(A  4-  BF)x,  (Ax  +  Bh(x))TP(Ax  -f  Bh(x))}. 

By  (8)  and  (9),  we  obtain 

(Ax  4-  Bszt(Fx))rP(Ax  +  Psat(Fx))  -  xTPx  <0,  Vx  €  S(P,  p)\{ 0}. 

This  shows  that  <?(P,p)  is  contractively  invariant  under  w  =  sat(Fx).  □ 

Theorem  2  implies  that,  for  the  single  input  case,  the  invariance  of  an  ellipsoid  £(P,  p)  under  a  saturated 
linear  control  «  =  sat(Fx)  is  in  some  sense  independent  of  F  as  long  as  the  condition  (A  4-  BF)TP(A  4- 
BF)  —  P  <  0  is  satisfied.  In  other  words,  suppose  that  both  F\  and  F2  satisfy  the  condition  (A  +BFi)TP(A  4- 
BFi)  —  P  <  0,  i  — 1,2,  then  the  maximal  invariant  ellipsoid  <?(P,p)  (with  p  maximized  under  a  fixed  P)  is 
the  same  under  either  w=sat(Fix)  or  u  =  sat(p2*)-  In  [6,  Chapter  11],  we  developed  a  computational  method 
to  determine  the  largest  p  such  that  <?(P,p)  can  be  made  invariant. 
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Fig.  2.  Invariant  ellipsoids  determined  with  different  methods. 


Example  1*  Consider  the  closed-loop  system  (3)  with 
"0.8876  —0.5555 
0.5555  1.5542 

Given 

_  F  5.0127  -0.6475 
P~  -0.6475  4.2135 

By  combining  Theorem  2  and  Hu  and  Lin’s  method  [6],  the  maximal  £{P,p)  is  £{P,p*)  with  p*  =  2.3490. 
Let’s  compare  the  largest  invariant  ellipsoid,  £(P,p*),  with  those  obtained  by  other  methods. 


-0.1124 

0.5555 


F  =  [—0.7651  -2.0299]. 


(1)  The  maximal  p  such  that  £(P,p)  C  SC(F)  is  p\  =0.8237; 

(2)  The  maximal  p  satisfying  the  condition  in  Proposition  1  is  pi  =  1.0710; 

(3)  The  maximal  p  satisfying  the  condition  in  Theorem  1  is  pi  =  p*  =  2.3490,  with 


H  =  [  —  0.1389  -  1.3018]. 

Shown  in  Fig.  2  is  a  comparison  of  the  invariant  ellipsoids  obtained  with  different  methods.  It  is  very 
interesting  to  note  that  p3  =p*.  In  this  case,  the  largest  invariant  ellipsoid  obtained  by  Theorem  1  is  not 
conservative  at  all.  In  fact,  as  we  have  proven  for  continuous-time  systems  in  [7],  if  m  =  1,  then  the  condition 
in  Theorem  1  (in  its  continuous-time  form)  is  also  necessary. 


2.3.  Estimation  of  the  domain  of  attraction  —  an  LMI  approach 


With  all  the  ellipsoids  satisfying  the  set  invariance  condition  in  Theorem  1,  we  would  like  to  choose  from 
among  them  the  “largest”  one  to  get  a  least  conservative  estimate  of  the  domain  of  attraction.  In  the  literature 
(e.g.,  see  [2,3,5]),  the  largeness  of  a  set  is  usually  measured  by  its  volume.  Here,  we  will  follow  the  idea  in 
[8]  and  take  the  shape  of  a  set  into  consideration.  Let  C  R"  be  a  prescribed  bounded  convex  set.  For  a 
set  S  C  R",  define 

aR(S):=sup{a  >  0:  ocAr  C  S}. 

If  ocr(iS)  ^  1,  then  AfR  C  S.  Two  typical  types  of  AfR  are  the  ellipsoids 
XR  =  {xeR”:  JcTfo«S  1},  R>0 
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and  the  polyhedrons 

A*  =  Co{Xi,X2,  •••,*/}• 

We  can  choose  the  reference  set  Xr  according  to  the  available  information  on  the  initial  conditions.  For 
instance,  if  some  possible  initial  conditions  are  known,  we  can  choose  Xr  as  a  polyhedron  containing  all 
these  initial  conditions.  In  the  extreme  case,  we  may  choose  XR  to  be  co{x0,  — xo}  when  we  want  to  know  if 
Xq  is  in  the  domain  of  attraction. 

Now  we  would  like  to  choose  from  all  the  ^(P,p)’s  that  satisfy  the  condition  in  Theorem  1  such  that 
the  quantity  aR(<?(P,p))  is  maximized.  For  this  reason,  we  call  Xr  the  shape  reference  set.  The  problem  of 
maximizing  the  contractively  invariant  ellipsoid  with  respect  to  a  shape  reference  set  can  be  formulated  as 


sup  a 

P>0,ptH 

s.t.  (a)  oXr  C  (10) 

(b)  (A  +  B(DtF  +  D~ H))JP(A  +  B(DtF  +  Df H))  -  P  <  0,  Vi€[l,2m], 

(c)  \hjx\  <  1,  Vx€/(P,p), 

We  will  transform  the  above  optimization  constraints  into  LMIs.  If  XR  is  a  polyhedron,  then  by  Schur 
complement,  (a)  is  equivalent  to 


a 2xJ  & 


T 


>0,  k  G  [1,  /]. 


R  ^  P 

a2  p 


>0. 


1/a 2 

Xk  (P/P)-' . 

If  ArR  is  an  ellipsoid  {x:  xJRx  <  1 },  then  (a)  is  equivalent  to 
1  /oc2R  I 
I  (P/p)"1 

Also  by  Schur  complement  and  some  manipulation,  the  constraint  (b)  is  equivalent  to 
(P/p)-1  (P/py'iA+BiDiF  +  D-H)?' 

(A  +  B(DjF  +  D~  H))(P/p)~l  (P/p)-1 

From  [8],  the  constraint  (c)  is  equivalent  to 

1  hjiP/py1 
[  (P/P)~'h]  (P/p)'1  . 

Let  7=  1/a2,  g  =  (P/p)-1  and  Z  =  H(P/p)~x .  Also  let  the  yth  row  of  Z  be  zj,  i.e.,  Zj  =  Ay  (P/p)-1 .  If  ATr 
is  a  polyhedron,  then  from  (11),  (13)  and  (14),  the  optimization  problem  (10)  can  be  rewritten  as 


>0,  i  €  [l,2m]. 


phjP-'h]  <  1 


^0, 


(11) 


(12) 


(13) 


(14) 


inf  y 

Q,z 

s.t.  (al ) 

(b) 


y  4 

Xk  Q 


>0,  k  €  [1,  /], 


Q  (AQ  +  B(D,FQ  +  D-Z))T 

AQ  +  B(DiFQ  +  D~Z)  Q 


>0,  t‘e[l,2m]. 


(15) 


(c) 


4  Q 


>0,  je  [1,  m], 


where  all  the  constraints  are  given  in  LMIs. 

If  ATr  is  an  ellipsoid,  we  just  need  to  replace  (al)  with  another  LMI, 

'yR  1 


(a2) 


I  Q 


>  o. 
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2.4 .  Controller  design 


Our  objective  in  this  section  is  to  choose  a  feedback  matrix  FGRwxn  such  that  the  estimated  domain  of 
attraction  as  obtained  by  the  method  of  Section  2.3  is  maximized  with  respect  to  Xr.  This  can  be  simply 
done  by  taking  the  F  in  (15)  as  an  extra  optimization  parameter.  To  make  the  optimization  easy,  we  use  a 
new  parameter  Y  to  replace  FQ  in  (15(b))  and  the  resulting  LMI  problem  is 


s*t.  (lS(al)X  (15(c)), 

-J  Q  (. AQ  +  B{DtY  +  D-Z ))T 

'  '  AQ  +  B(DjY  +  D~Z)  Q 


1 


(16) 


>0,  i€[  1,2"]. 


The  optimal  F  will  be  recovered  from  YQ~l.  Denote  the  optimal  value  of  the  above  optimization  problem 
as  y\ 

Let’s  consider  a  simpler  optimization  problem 


inf  y 

G.2 


s.t  (15(al )),  (15(c)), 

r  e  <^>Ti>0. 

AQ  +  BZ  Q 


(17) 


Denote  its  optimal  value  as  y*.  We  claim  that  y*  =  y*.  The  argument  goes  as  follows.  Since  (bl)  is  only  one 
of  the  inequality  constraints  in  (b)  (when  £>,=()),  (17)  can  be  viewed  as  a  problem  resulting  from  dropping 
the  other  2m  -  1  constraints  in  (16(b)),  hence  we  have  y*  ^  y*.  On  the  other  hand,  we  can  also  see  (bl)  as  a 
result  of  (b)  by  restricting  7  =  Z  (recall  that  Dt  -f  D~  =  /).  This  means  that  the  constraints  of  (17)  are  more 
restrictive  than  that  of  (16).  Hence  (16)  admits  a  less  infimum  than  (17),  i.e.,  y*  ^  y*.  In  summary,  we  must 
have  y*  =  y*. 

In  view  of  the  above  observation,  we  might  as  well  solve  the  simpler  optimization  problem  (17)  if  our 
objective  is  to  enlarge  the  domain  of  attraction.  If  we  solve  (17)  and  let  H  —  ZQ~X,  then  the  resulting 
invariant  ellipsoid  is  in  the  linear  region  of  the  state  feedback  w  =  sat(i/x),  i.e.,  S(P,p)  C  &(H).  In  this 
case,  the  convergence  of  trajectories  would  be  generally  very  slow  inside  the  ellipsoid.  Suppose  that  we  have 
another  feedback  w  =  sat(i7x)  such  that  F  and  H  satisfy  (5),  then  by  Theorem  1,  the  ellipsoid  is  also  invariant 
under  w  =  sat(Fx).  There  could  be  infinitely  many  such  F’s.  We  may  choose  among  these  F9 s  to  optimize 
other  performances  such  as  convergence  rate. 


3.  Disturbance  rejection 
3, 1.  Problem  statement 

Consider  the  open-loop  system 

x(kJt-  \)=Aoc(k)  +  Bs&t(u(k))  +  Ew(k),  x  eUn,  ueUm,  (18) 

where,  without  loss  of  generality,  we  assume  that  the  bounded  disturbance  w  belongs  to  the  set 
4F :={w:  w(k)7w(k)  ^  1,  Wk  ^  0}.  Let  the  state  feedback  be  u—Fx.  The  closed-loop  system  is 

x(k  -f  1)  —Ax(k)  H-  BsdX(Fx(k))  +  Ew(k).  (19) 

For  an  initial  state  jc(0)=jco,  denote  the  state  trajectory  of  the  closed-loop  system  under  w  as  \j/(k,XQyw). 
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Our  primary  concern  is  the  boundedness  of  the  trajectories.  A  set  in  Un  is  said  to  be  invariant  if  all  the 
trajectories  starting  from  it  will  remain  in  it  regardless  of  we  iV',  An  ellipsoid  <f(P,p)  is  said  to  be  strictly 
invariant  if 

(Ax  +  Bszt(Fx)  +  Ew)tP(Ax  +  Bsat(Fx)  -f  Ew)  <  p 
for  all  x  G  <f(P,p)  and  w,wTw  <  1. 

The  notion  of  invariant  set  plays  an  important  role  in  studying  the  stability  and  other  performances  of  a 
system,  see  [1,2,9]  and  the  references  therein.  To  keep  the  state  trajectory  bounded  for  a  large  range  of  initial 
conditions,  it  is  desired  to  have  a  large  invariant  set.  On  the  other  hand,  a  small  invariant  set  indicates  that 
the  system  is  insensitive  to  the  disturbance.  Suppose  that  we  have  an  invariant  set  containing  the  origin  in  its 
interior,  then  all  the  trajectories  starting  from  the  origin  will  remain  inside  the  invariant  set  regardless  of  the 
disturbance.  Hence  for  the  purpose  of  disturbance  rejection,  we  would  also  like  to  have  a  small  invariant  set 
containing  the  origin  in  its  interior. 

To  formally  state  the  objectives  of  this  section,  we  need  to  extend  the  notion  of  the  domain  of  attraction 
of  an  equilibrium  to  that  of  an  invariant  set  as  follows. 

Definition  1.  Let  33  be  a  bounded  invariant  set  of  (19).  The  domain  of  attraction  of  33  is 
UeR":  lira  dW(k,x0,w),  @)  =  0,  Vweir'' , 

k—>oo 

where  d(j/(k,x^w\33)  =  inf*€# \\\j/(k,x0} w)  —x\\  is  the  distance  from  ^(Kx0yw)  to  33. 

In  the  above  definition,  ||*||  can  be  any  norm.  The  problems  we  are  to  address  in  this  section  are  formulated 
as  follows. 

Problem  1  ( Set  invariance  analysis).  Let  F  be  known.  Given  an  ellipsoid  <f(P,p),  determine  if  #(P,p)  is 
(strictly)  invariant. 

Problem  2  ( Invariant  set  enlargement).  Given  a  shape  reference  set  I0  C  Un,  design  an  F  such  that  the 
closed-loop  system  has  an  invariant  set  &(P,p)  D  ol2X0  with  cc2  maximized. 

Problem  3  (Disturbance  rejection).  Given  a  shape  reference  set  Xqo  c  U71,  design  an  F  such  that  the  closed- 
loop  system  has  an  invariant  set  &(P,  p)  C  a3Aoo  with  a3  minimized.  Here  we  can  also  take  Xoo  to  be  the 
(possibly  unbounded)  polyhedron  {xeIR":  |cpc|  ^  1,  ie  [l,p]}.  In  this  case,  the  minimization  of  a3  leads  to 
the  minimization  of  the  Loo-norm  of  the  output  y  =  Cxe  Rp. 

Problem  4  (Disturbance  rejection  with  guaranteed  domain  of  attraction).  Given  two  shape  reference  sets, 
Xqq  and  Xq.  Design  an  F  such  that  the  closed-loop  system  has  an  invariant  set  £(P,  1)  D  Xo,  and  for  all 
xo  £<?(P,  1),  ^(k,Xo,w)  will  enter  a  smaller  invariant  set  S(P,p\)  C  a^oo  with  a4  minimized. 

3.2.  Condition  for  set  invariance 

We  consider  the  closed-loop  system  (19)  with  a  given  F. 

Theorem  3.  For  a  given  ellipsoid  <?(P,p),  if  there  exist  an  H  €  Umxn  and  a  positive  member  rj  such  that 
(1  +  ri)(A  +  B(DiF  +  D~H))rP(A  +  5(Z),F  +  D~H ))  +  -  ri  P  ^  (<  )0  (20) 

for  all  i  G  [1,2W],  and  <£(P,p)  C  -Sf(ff),  then  <£(P,p)  is  a  (strictly)  invariant  set  for  system  (19). 

Proof.  We  prove  the  strict  invariance.  That  is,  we  will  show  that 

(Ax  +  BsdX(Fx)  +  Ew)rP(Ax  +  Psat(Px)  +  Ew)  <  p,  Vx  €  S(P ,  p),  wrw  ^  1 . 
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Since  £(P,p)  C  PP(B\  similar  to  the  proof  of  Theorem  1,  we  can  show  that 

Ax  4-  i?sat(Fx)  +  Ewe  co{Ax  4-  B(DfF  4-  D]~H)x  -I-  Ew:  i  e  [1, 2m]} 

for  every  and  x£&(P,p).  By  the  convexity  of  the  function  V(z)  =  zTPz,  for  every  x£&(P9p)  and 

every  w,  wTw  <  1, 

(Ax  4-  BsaX(Fx)  4-  Ew)rP(Ax  4-  Bsat(Fx)  4-  Ew) 

*£  .max^(^jc  +  B(DiF  +  D,"i/)x  4- Ew)rP(Ax  +  £(AF  +  >  +  Ew)- 

Using  the  fact  that  ( a  +  b)T(a  +  b)  <  (1  4-  tj)aTa  -f  (1  4-  l/t})bTb  for  any  tj  >  0,  we  have 
(Ax  -f  ^sat(ia)  +  £>v)tP(^x  -f  Bszt(Fx)  4-  .Ew) 

<  .max^l  +  rj)x7(A  +  B{DtF  +  D~H))rP(A  +  B{DtF  +  D~H))x  +  ^1  +  ^)  wTETPEw 

<  max  (1  +  V)xt(A  +  B(D.F  +  D7H))JP(A  +  B(DtF  +  D~H))x  +  ( 1  +  -)  Xm„(ErPE). 

xe[i,2n]  \  r\  j 

To  prove  the  strict  invariance,  it  suffices  to  show  that  there  exists  an  rj  >  0  such  that  for  all  xed£(P,p)  and 
for  all  i£  [l,2m], 

(1  +  V)xt(A  +  B(D,F  +  D~H))tP(A  +  B(D,F  +  DfH))x  +  (l  +  W- ErPE )  <  p.  (21) 

Noticing  that  1  —x T(P/p)x  on  d&(P9p\  we  see  that  (21)  is  guaranteed  by  (20).  □ 
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Hence,  the  optimization  problem  (22)  is  equivalent  to 

inf  y 
i/>0,  X,QtYyZ 

s.t.  (15(al)),  (15(c)),  (23),  (24). 


(25) 


We  see  that  (15(al))  and  (15(c))  are  LMIs.  If  we  fix  rj  and  A,  then  (23)  and  (24)  are  also  LMIs.  The 
global  infimum  of  y  can  be  obtained  by  running  tj  from  0  to  oo  and  A  from  0  to  rj/(  1  +rj). 

In  fact,  the  computation  can  be  simplified  by  reducing  the  number  of  parameters  fixed  beforehand  (rj  and 
A)  from  two  to  one.  Denote 


We  see  that  as  rj  varies  from  0  to  00  and  A  from  0  to  i//(l  +  r\),  g  varies  from  0  to  1.  If  we  fix  g,  then 
1 


A=  1 


l+tj 


-V9- 


It  can  be  shown  with  standard  analysis  that  as  tj  varies  from  0  to  00,  the  maximal  value  of  A  is 


A*  =  (l-v^)2, 

obtained  at  rj*  =  (1  /y/g)  -  1.  Since  the  constraint  (24)  is  the  least  restrictive  by  taking  A  =  A*,  the  optimal 
solution  to  (25)  will  be  obtained  with  X  —  X*.  In  view  of  these  arguments,  we  can  solve  (25)  by  running  g 
from  0  to  1,  taking  A  =  A*  =  (1  -  -Jg  f,  solving  the  resulting  LMI  problems  and  picking  the  minimal  y.  In 
this  case,  we  only  need  to  fix  the  parameter  g  before  solving  an  LMI  problem. 

For  Problem  3,  we  have 

inf  0(3 

P>0,p,tl>0,F,H  (26) 

s.t.  (a)  £{P,p)  C  1x3X00,  (22(b)),  (22(c)), 


which  can  be  solved  similarly  as  (22). 


3.3.  Disturbance  rejection  with  guaranteed  domain  of  attraction 

Given  X0  C  5?",  if  the  optimal  solution  of  Problem  2  is  ot|  >  1,  then  there  are  infinitely  many  choices  of  the 
feedback  matrices  F’s  such  that  X0  is  contained  in  some  invariant  ellipsoid.  We  will  use  this  extra  freedom 
for  disturbance  rejection.  That  is,  to  construct  another  invariant  set  £{P,p\)  which  is  as  small  as  possible 
with  respect  to  some  X^.  Moreover,  Xq  is  inside  the  domain  of  attraction  of  £{P,p  1).  In  this  way,  all  the 
trajectories  starting  from  X0  will  enter  S{P,p\)  C  04X00  for  some  a4  >  0.  Here  the  number  a4  is  a  measure 
of  the  degree  of  disturbance  rejection. 

Before  addressing  Problem  4,  we  need  to  answer  the  following  question:  Suppose  that  for  given  F  and 
P,  both  £{P,  p\ )  and  £{P,pf),  P\  <  Pi,  are  strictly  invariant  sets,  then  under  what  conditions  will  the  other 
ellipsoids  £{P,p),  pe(pi,p2)  also  be  strictly  invariant?  If  they  are,  then  all  the  trajectories  starting  from 
within  £{P,pz)  will  enter  £{P,p\)  and  remain  inside  it. 

Theorem  4.  Given  two  ellipsoids,  £ (P,  p  1 )  and  £{P, p2),  Pi  >  Pi  >  0,  if  there  exist  H\,Hz  €  IRmX”  and  a 
positive  rj  such  that 

(1  +  rj){A  +  B(DiF  +  D~H]  ))rP(A  +  F(AF  +  D~HX ))  +  (L^Xmm(ETPE)  -ljp<0,  (27) 

(1  +  tj)(A  +  B(D,F  +  D~H2))tP(A  +  B(D,F  +  D~H2))  +  ( Ltlxmm(ETPE)  -  1 )  P  <  0,  (28) 

\  P2rl  / 
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for  all  z€[l,2m],  and  <f(P,pi)  C  -S?(ifi),  <?(P,p2)  C  S£(H2\  then  for  every  pe[piyp2],  there  exists  an 
H  eUmxn  such  that 

(1  +  f])(A  +  B{DtF  +  D~  H))rP(A  +  B(DtF  +  D~H ))  +  2ma*(£TPP)  -  l)  P  <  0  (29) 

P' 1  / 

and  £(P,p)6  SE{H).  This  implies  that  <?(P,  p)  is  also  strictly  invariant. 


Proof.  Let  h\j  and  h2j  be  the  yth  rows  of  Hi  and  Hj,  respectively.  The  conditions  F{P,p\)  c  BF{H\ )  and 
S’(P,p2)  C  E£{H2)  are  equivalent  to 


i/pi  Kj 


l/Pi  h2j 
hi,  P 


^  0,  j  €  [l,m]. 


Since  p  £  [pi,P2],  there  exists  an  a  £  [0, 1]  such  that  l/p  =  a/pl  +(1  — a )/p2.  Let  H  =  aH\  +  (l  -a )H2.  Clearly 

r vc  *,l  . 


h T  P 


which  implies  that  <?(P,p)  C  J Sf(if).  Since  (27)  and  (28)  are  equivalent  to 

7T^  (l-^V^ax(PTPP))p  (A+B(DiF  +  D~Hi))t 
1  +  *i  \  Pin  J  >o 

A+B(DiF  +D~Hi)  P-1 


frM1-—  w 

1  +*l\  P2t] 

A  +  B(DiF  +  D~ 


(E  PE)  P  (A  +  B{DiF  +  D~H2))' 


by  convexity,  we  have 


1  +1  \  P*l 
A  +  BiPil 


Amax( ElPE)  P  ( A+  B{DiF  +  D~H)y 


L  A  +  B(D,F  +  D~  H) 

which  is  equivalent  to  (29).  □ 


In  view  of  Theorem  4,  to  solve  Problem  4,  we  can  construct  two  invariant  ellipsoids  &(P,p\)  and  &(P,p2) 
satisfying  the  condition  of  Theorem  4  such  that  Xo  C  &(P2  p2)  and  *f(P,pi)  C  with  oc4  minimized. 

Since  p2  can  be  absorbed  into  other  parameters,  we  assume  for  simplicity  that  p2  =  1  and  p\  <  1.  Problem  4 
can  then  be  formulated  as 

inf  ol4 

P>0,0<P)  <\,r}>0,F,H\,H2 

s*t.  (a)  Xo  C  <?(P,  1 ),  £{P,Pi)  C  04X00, 

( 1  -  —  Amax(PTPP))  P  (A  +  B(DtF  +  D7  Hi  ))T 
l  +  r}  \  pin  J 

A  +  B{D,F  +  D~  H)  P-1 

,  N  f—  ( 1  -  —— ^Amax(PTPP))  P  (A  +  B(DiF  +  D~H2))t 

(c)  1  +  ri  \  r\  J 

A  +B(B,F  +  DrH2)  P~l 

(d)  \hijx\  <  1,  Vx  €  £(P,pi),  y€[l,«], 

(e)  \h2Jx\  ^  1,  Vx  €  <?(P,  1),  ;e[l,m]. 

If  we  fix  pi,  X  and  rj,  then  the  constraints  of  the  optimization  problem  can  be  transformed  into  LMIs.  To 
obtain  the  global  infimum,  we  may  vary  pi  from  0  to  1,7/  from  0  to  oo  and  X  from  0  to  p\Y\/(\  4-7/).  Similar 
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Fig.  3.  The  invariant  ellipsoids  and  the  null  controllable  region. 


to  the  treatment  of  the  optimization  problem  (25),  we  can  reduce  the  number  of  parameters  fixed  beforehand 
(pi,  A  and  rj)  from  three  to  two. 

3,4 .  An  example 


Consider  the  system  (18)  with 


"0.9741 

-0.2474" 

' -0.0259" 

A  = 

0.2474 

1.2710 

.  B  = 

0.2474 

0.0057 

0.0082 


Let’s  first  consider  Problem  2  of  enlarging  the  invariant  ellipsoid.  Here  we  choose  the  shape  reference  set  as  a 
unit  ball,  i.e.,  Xq  =  <?(/,  1 ).  By  solving  (22),  we  obtain  (*2  =  0.6337,  along  with  =  0.0143,  2*  =  1.9879*  10“4 
and 


1.2148  -0.1667 
-0.1667  2.4681 


F*  =  [  —  0.5726  -  1.2574]. 


The  invariant  set  «?(P*,1)  is  the  smaller  ellipsoid  in  Fig.  3.  The  larger  ellipsoid  is  obtained  as  the  maximal 
invariant  ellipsoid  in  the  absence  of  disturbance  (F  =  0).  The  outmost  closed  curve  is  the  boundary  of  the 
null  controllable  region  of  the  system  in  the  absence  of  disturbance,  which  is  the  largest  possible  invariant 
set  that  can  be  achieved  with  any  control  law  (see  [6]). 

Next,  we  consider  Problem  3.  We  take  the  reference  set  also  to  be  the  unit  ball.  The  optimal  013  is 
found  to  be  ocj  =0.0825  with  tf  =0.2126,  2*  =0.0307  and 


P*  = 


1920.2  -1884.6 
-1884.6  2150.6  ’ 


F*  =  [-  0.3314  -2.4721]. 


For  Problem  4,  we  take  Xoo  to  be  the  unit  ball  and  X0  —  a0<?(/,l).  From  the  solution  to  Problem  2,  we 
know  that  ao  must  be  less  than  <*2  =  0.6337.  From  the  solution  to  Problem  3,  we  know  that  must  be 
greater  than  aj  =  0.0825.  First,  we  choose  «o  =  0.5.  By  solving  (30),  we  obtain  0^  =  0.2960,  along  with 
*7*  =  0.0431,  r  =2.4565*  10"4,  p?  =  0.1440  and 


P*  = 


1.9000  -0.7335 
-0.7335  3.7429 


F*  =  [  -  0.5707 


-  1.4722], 


In  Fig.  4,  the  smaller  dotted  ellipsoid  is  £(P*>p\)  and  the  bigger  one  is  <^(P*,1).  A  trajectory  start¬ 
ing  from  the  boundaiy  of  &{P*>  1)  is  plotted  in  Fig.  4.  In  the  simulation,  the  disturbance  is  chosen  as 
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Fig.  4.  The  invariant  ellipsoids  and  a  trajectory,  ao  —  0.5,  aj  =  0.2960. 


Fig.  5.  The  invariant  ellipsoids  and  a  trajectory,  ao  =  0.3,  aj  =0.1262. 


w(Ar)  =  sign(sin(0.2fc)).  We  see  that  the  trajectory  enters  £(P,p\)  and  stays  inside  of  it.  However,  the  distur¬ 
bance  may  not  be  rejected  to  a  satisfactory  level.  This  is  because  enlarging  the  outer  ellipsoid  and  reducing 
the  inner  ellipsoid  are  conflicting  objectives.  To  obtain  a  better  disturbance  rejection  performance,  we  have  to 
choose  smaller  Xq.  For  example,  if  we  choose  ao  =0.3,  then  we  obtain  a}  =0.1262,  along  with 


P*  = 


5.1710  —3.9277 
—3.9277  8.5125 


P*  =  [  —  0.5123  -  1.8880]. 


Fig.  5  shows  the  invariant  ellipsoids  £(P*,  1)  and  <f(P*,pi),  and  a  trajectory  starting  from  the  boundary  of 


4.  Conclusions 

We  considered  linear  systems  subject  to  actuator  saturation  and  persistent  disturbance.  Simple  criteria  for 
determining  if  a  given  ellipsoid  is  contractively  invariant  have  been  derived.  With  the  aid  of  these  criteria, 
we  developed  analysis  and  design  methods  for  closed-loop  stability  and  disturbance  rejection.  Examples  were 
used  to  demonstrate  the  effectiveness  of  these  methods. 
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Abstract 

We  present  a  method  for  estimating  the  domain  of  attraction  of  the  origin  for  a  system  under  a  saturated  linear  feedback.  A 
simple  condition  is  derived  in  terms  of  an  auxiliary  feedback  matrix  for  determining  if  a  given  ellipsoid  is  contractively  invariant. 
This  condition  is  shown  to  be  less  conservative  than  the  existing  conditions  which  are  based  on  the  circle  criterion  or  the  vertex 
analysis.  Moreover,  the  condition  can  be  expressed  as  linear  matrix  inequalities  (LMIs)  in  terms  of  all  the  varying  parameters 
and  hence  can  easily  be  used  for  controller  synthesis.  This  condition  is  then  extended  to  determine  the  invariant  sets  for  systems 
with  persistent  disturbances.  LMI  based  methods  are  developed  for  constructing  feedback  laws  that  achieve  disturbance  rejection 
with  guaranteed  stability  requirements.  The  effectiveness  of  the  developed  methods  is  illustrated  with  examples.  ©  2001  Elsevier 
Science  Ltd.  All  rights  reserved. 

Keywords:  Actuator  saturation;  Stability;  Domain  of  attraction;  Invariant  set;  Disturbance  rejection 


1.  Introduction 

In  this  paper,  we  are  interested  in  the  control  of  lin¬ 
ear  systems  subject  to  actuator  saturation  and  persistent 
disturbances: 

x—Ax  +  Ba(u)  +  Ew,  jceR",  ue Rm,  weR9,  (1) 

where  x  is  the  state,  u  is  the  control,  w  is  the  disturbance 
and  <r()  is  the  standard  saturation  function.  Our  first 
concern  is  the  closed-loop  stability  (when  w  =  0)  under 
a  given  linear  state  feedback  u=Fx.  There  has  been  a 
lot  of  work  on  this  topic  (see,  e.g.,  Davison  &  Kurak, 
1971;  Gilbert  &  Tan,  1991;  Hindi  &  Boyd,  1998;  Khalil, 
1996;  Loparo  &  Blankenship,  1978;  Pittet,  Tar- 
bouriech,  &  Burgat,  1997;  Vanelli  &  Vidyasagar,  1985; 
Weissenberger,  1968  and  the  references  therein).  In 


*  This  paper  was  not  presented  at  any  IFAC  meeting.  This  paper 
was  recommended  for  publication  in  revised  form  by  Associate  Editor 
Andrew  R.  Teel  under  the  direction  of  Editor  Hassan  Khalil. 

*  Corresponding  author.  Tel.:  +1-434-9246342;  fax:  +  1-434- 
9248818. 

E-mail  addresses:  th7f@virginia.edu  (T.  Hu),  zl5y@virginia.edu 
(Z.  Lin),  bmchen@nus.edu.sg  (B.M.  Chen). 

1  Supported  in  part  by  the  US  Office  of  Naval  Research  Young 
Investigator  Program  under  grant  N00014-99-1-0670. 


particular,  various  simple  and  general  methods  for  esti¬ 
mating  the  domain  of  attraction  have  been  developed  by 
applying  the  absolute  stability  analysis  tools,  such  as  the 
circle  and  Popov  criteria  (see,  e.g.,  Hindi  &  Boyd,  1998; 
Khalil,  1996;  Pittet  et  al.,  1997  ;  Weissenberger,  1968), 
where  the  saturation  is  treated  as  a  locally  sector  bounded 
nonlinearity  and  the  domain  of  attraction  is  estimated  by 
use  of  quadratic  and  Lur’e  type  Lyapunov  functions.  In 
Hindi  and  Boyd  (1998)  and  Pittet  et  al.  (1997),  the  con¬ 
dition  for  local  stability  and  some  performance  problems 
are  expressed  in  terms  of  (nonlinear)  matrix  inequalities 
in  system  parameters  and  other  auxiliary  optimization 
parameters.  By  fixing  some  of  the  parameters,  these 
matrix  inequalities  simplify  to  linear  matrix  inequalities 
(LMIs)  and  can  be  treated  with  the  LMI  software. 

Since  the  circle  criterion  is  applicable  to  general  mem¬ 
oryless  sector  bounded  nonlinearities,  we  can  expect  the 
conservatism  in  estimating  the  domain  of  attraction  when 
it  is  applied  to  the  saturation  nonlinearity.  In  this  paper, 
a  less  conservative  estimation  of  the  domain  of  attraction 
is  obtained  by  using  a  quadratic  Lyapunov  function.  This 
is  made  possible  by  exploring  the  special  property  of  sat¬ 
uration.  Moreover,  since  this  condition  is  given  in  terms 
of  LMIs,  it  is  very  easy  to  handle  in  both  analysis  and 
design. 


0005-1098/02/$- see  front  matter  ©  2001  Elsevier  Science  Ltd.  All  rights  reserved. 
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In  the  presence  of  disturbance,  we  are  interested  in 
knowing  if  there  exists  a  bounded  invariant  set  such  that 
all  the  trajectories  starting  from  inside  of  it  will  remain  in 
it.  This  problem  was  addressed  by  Blanchini  (1990)  and 
Blanchini  (1994).  In  this  paper,  we  would  further  like  to 
synthesize  feedback  laws  that  have  the  ability  to  reject 
the  disturbance.  Here  disturbance  rejection  is  in  the  sense 
that,  there  is  a  small  (as  small  as  possible)  neighborhood 
of  the  origin  such  that  all  the  trajectories  starting  from  the 
origin  will  remain  in  it.  This  performance  was  analyzed 
by  Hindi  and  Boyd  (1998)  for  the  class  of  disturbances 
with  finite  energy.  In  this  paper,  we  will  deal  with  persis¬ 
tent  disturbances  and  propose  a  controller  design  method. 

Furthermore,  we  are  also  interested  in  the  problem 
of  asymptotic  disturbance  rejection  with  nonzero  initial 
states.  A  related  problem  was  addressed  by  Hu  and  Lin 
(2001b)  and  Saberi,  Lin,  and  Teel  (1996),  where  the  dis¬ 
turbances  are  input  additive  and  enter  the  system  before 
the  saturating  actuator,  i.e.,  the  system  has  a  state  equa¬ 
tion:  x=Ax  +  Ba(u  +  w).  It  is  shown  in  these  papers 
that  given  any  positive  number  D,  any  compact  subset  Zo 
of  the  null  controllable  region  and  any  arbitrarily  small 
neighborhood  Zoo  of  the  origin,  there  is  a  feedback  control 
such  that  any  trajectory  starting  from  within  Z0  will  en¬ 
ter  Zoo  in  a  finite  time  for  all  disturbances  w:||w||oo  =$  D. 
We,  however,  could  not  expect  to  have  this  nice  result  for 
system  (1),  where  the  disturbance  enters  the  system  after 
the  saturating  actuator.  If  w  or  E  is  sufficiently  large,  it 
may  even  be  impossible  to  keep  the  state  bounded.  What 
we  can  expect  is  to  have  a  setZo  (as  large  as  we  can  get) 
and  a  set  Zx  (as  small  as  we  can  get)  such  that  all  the 
trajectories  starting  from  Z0  will  enter  Zx  in  a  finite  time 
and  remain  in  it  thereafter. 

This  paper  is  organized  as  follows.  Section  2  addresses 
the  analysis  of  and  design  for  closed-loop  stability.  Sec¬ 
tion  3  addresses  issues  related  to  disturbance  rejection.  A 
brief  concluding  remark  is  given  in  Section  4. 


2.  Stability  analysis 

2.1.  Problem  statement 

Consider  the  open-loop  system 

x=Ax  +  Bo(u),  jceE",  u€Rm,  (2) 

where  u(-)  is  the  standard  saturation  function  of  appro¬ 
priate  dimensions.  In  the  above  system,  cr :  R”  — >  Rm, 
and  <t(w)  =  [<7(wi)  o(u2)  •••  cr(«m)]T,  where  a (w,)  = 
sgn(M;)min{l,|w,|}.  Here  we  have  slightly  abused  the 
notation  by  using  a  to  denote  both  the  scalar  valued 
and  the  vector  valued  saturation  functions.  Suppose  that 
a  state  feedback  u=Fx  has  been  designed  such  that 
A  +  BF  is  Hurwitz.  We  would  like  to  know  how  the 
closed-loop  system  behaves  in  the  presence  of  saturation 


nonlinearity,  in  particular,  to  what  extent  the  stability  is 
preserved.  Our  main  objective  in  this  section  is  to  obtain 
an  estimate  of  the  domain  of  attraction  of  the  origin  for 
the  closed-loop  system 

x=Ax  +  Bo{Fx).  (3) 

Denote  the  z'th  column  of  B  as  h,  and  the  zth  row  of  F  as 
/,.  Then  BF  =  bjx  +  •  •  •  +bmfm.  For  a  matrix  F  <E  RmXn, 
define 

<?(F):={x€ R”:  |/,x|*SUe[l,m]}. 

If  F  is  the  feedback  matrix,  then  SF{F)  is  die  region  in 
the  state  space  where  the  control  is  linear  in  x. 

For  x(0)=xoeR",  denote  the  state  trajectory  of 
system  (3)  as  t//(f,Xo).  Then  the  domain  of  attraction  of 
die  origin  is 

y  :=  /x0  €  Rn:  lim  i l/(t,x0)  =  cA  . 

<— >oo 

Let  P  e  Jtnxn  be  a  positive-definite  matrix.  Denote 
i(P,  p)  =  {x  e  R":  xTPx  2$  p}. 

Let  V(x)=x1Px.  The  ellipsoid  <?(P,p)  is  said  to  be  con- 
tractively  invariant  if  V (x)  =  2xTP(Ax+Bo(Fx))  <  0  for 
all  x  €  &(P,p)\{0}.  Clearly,  if  S{P,p)  is  contractively  in¬ 
variant,  then  it  is  inside  the  domain  of  attraction.  We  will 
develop  conditions  under  which  &(P,  p)  is  contractively 
invariant  and  hence  obtain  an  estimate  of  the  domain  of 
attraction. 

2.2.  A  set  invariance  condition  based  on  circle  criterion 

A  multivariable  circle  criterion  is  presented  in  Khalil 
(1996,  Theorem  10.1)  and  is  applied  to  estimate  the  do¬ 
main  of  attraction  for  system  (3),  with  a  given  feedback 
gain  P,  in  Hindi  and  Boyd  (1998)  and  Pittet  et  al.  (1997). 

Proposition  1  (Khalil,  1996;  Pittet  et  al.,  1997).  Assume 
that  ( F,A,B )  is  controllable  and  observable.  Given  an 
ellipsoid  <f(P,p),  if  there  exist  positive  diagonal  matri¬ 
ces  KhK2  €  Rnx"  with  Z,  <  I,  Ki  +  K2  5*  /  such  that 

(A  +  BKtF)TP  +  P(A  +  BK\F) 

+  \(FtK2  +  PB)(K2F  +  BtP)  <  0  (4) 

and  £{P,p)  C  if(ZjP),  then  A(P,p)  is  a  contractively 
invariant  set  and  hence  inside  the  domain  of  attraction. 

A  similar  condition  based  on  circle  criterion  is  given  in 
Hindi  and  Boyd  (1998).  These  conditions  are  then  used 
for  stability  and  performance  analysis  with  LMI  software 
in  Hindi  and  Boyd  (1998)  and  Pittet  et  al.  (1997).  Since 
inequality  (4)  is  not  jointly  convex  in  Ku  K2  and  P,  these 
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parameters  need  to  be  optimized  separately  and  there  is 
^  no  guarantee  that  the  global  optimal  solutions  can  be 
obtained  for  related  problems. 

23.  An  improved  condition  for  set  invariance 

We  will  develop  a  less  conservative  set  invariance 
condition  by  exploring  the  special  property  of  the  satu¬ 
ration  nonlinearity.  It  is  based  on  direct  Lyapunov  func¬ 
tion  analysis  in  terms  of  an  auxiliary  feedback  matrix 
HeRmXn.  This  condition  turns  out  to  be  equivalent  to 
some  LMIs.  Denote  the  zth  row  of  H  as  ht.  For  two 
matrices  F,H  G  RmX"  and  a  vector  v  €Rm,  denote 

r  vi/i  +(1  - Vi)hi  i 

M(y,F,H)=  I  :  I  .  (5) 

Vmfm  "t"  (1  )hm 

Let  "T  =  {v  G  Rm:  v,  =  1  or  0}.  There  are  2m  elements  in 
■f,  We  will  use  avef  to  choose  from  the  rows  of  F  and 
H  to  form  a  new  matrix  M{y, F,H)\  if  v,  =  1 ,  then  the  zth 
row  of  M(y,F,H)  is  /,•  and  if  v,-  =  0,  then  the  zth  row  of 
M(v,F,H  )  is  hi.  For  example,  suppose  zn  =  2,  then 

{M(y,F,H):  vg^}  =  * H,  ^  ^  J  . 

©Theorem  1.  Given  an  ellipsoid  <f(P,  p),  if  there  exists  an 
He Rmx"  such  that 

(A  +  BM(v,F,H))TP  +  P(A  +  BM{y,F,H))  <  0  (6) 

for  all  vef  and  <?(P,p)  C  d£{H),  i.  e. ,  |/z,x|  <  1  for 
all  x  e  S(JP,  p),  i  G  [1,  m],  then  S(P, p)  is  a  contractively 
invariant  set. 

Proof.  Let  V(x)  —  xTPx,  we  need  to  show  that 
F(x)  =  2xtP(Ax  +  B<r(Fx ))  <0  Vx  G  £{P,  p)\{0}. 

Here  we  have 

V(x)  =  2xtAtPx  +  2xJPBa(Fx) 

=  2xtAtPx  +  V  2 xTPi,cr(/,x). 

i= 1 

For  each  term  2xTPZ>,<r(/,x), 

(1)  If  xTPbi  >  0  and  fpx  <  -  1,  then  2xTPbio(flx)  = 
-2 xTPbt  <  2xTPbjhiX.  Here  we  note  that  - 1  <  h{x  Vx 
eS{P,p). 

(2)  If  xTPbj  ^  0  and  /,x>  -  1,  then  cr(/;x)  <  fpc  and 
2x1Pbia(f  jx)  2xrPbjfjX. 

(3)  lfxTPbi  <  Oand  fpc  ^  l,then2xTPZ>,<r(/,x)  =  2xTPfc, 
^  2xrPblhix.  Here  we  note  that  1  >  /z,x  Vx 
1  €  £(P ,p). 

(4)  If  xrPbj  0  and  f tx  <  1,  then  <r(/,x)  3s  fpc  and 
2 xTPfc,cr(/1x)  ^  2 xrPbifiX. 


Combining  all  the  four  cases,  we  have 

2x1Pbio{fix)  <  max{2xTPZ>,/z,x,  2 xTPh,/,x} 

for  every  x  t  S‘(P, p )  and  each  z'€[l,m].  Therefore,  for 
every  x  G  £(P,  p), 

m 

V(x)  <  2xt^tPx  4-  V  max{2xTPb,7z,x,  2 xTPh,/,x}. 

i=i 

Now  we  associate  every  x€<?(P,  p)  with  a  vector 
v(x)  €  V  as  follows:  if  2x1Pbihix  <  2 xTP6,-/,x,  then  we 
set  v,  =  1,  otherwise  we  set  v,-  =  0.  It  follows  that 

m 

V(x)  <  2xTArPx  +  2V ( v^Pbifx  +  (1  -  vl)xTPh,/z,x) 

i=l 

/  m  \ 

=  2xrArPx  +  2 xTP  V  bfvifi  +  (1  -  v,- )/z, )  x 

f=i 

=  2 xr(A  +  BM(v,F,H))rPx. 

In  view  of  (6),  we  have  that  V (x)  <  0  for  all  x€ 
£(P,p)\{0}.  □ 

A  geometric  interpretation  of  Theorem  1  can  be  found 
in  Hu  and  Lin  (2001a).  If  we  restrict  H  to  be  K\F,  where 
K\  is  the  same  as  that  in  Proposition  1,  then  we  have 

Corollary  1.  Given  an  ellipsoid  £{P,  p),  if  there  exists  a 
positive  diagonal  matrix  K\  gR"*"  such  that 

(. A  -f-  BM(y,F,K\F))7 P  +  P(A  +  BM(y,F,K\F))  <  0 

for  all  vef  and  £(P,p)  C  SP{KiF),  then  £(P, p)  is  a 
contractively  invariant  set. 

This  corollary  is  equivalent  to  Theorem  10.4  in  Khalil 
(1996)  when  applied  to  saturation  nonlinearity.  Obvi¬ 
ously,  the  condition  in  Corollary  1  is  more  conservative 
than  that  in  Theorem  1  because  the  latter  provides  more 
freedom  in  choosing  the  H  matrix.  However,  it  is  evident 
from  Khalil  (1996)  that  the  condition  in  Proposition  1  is 
even  more  conservative  than  that  in  Corollary  1.  Com¬ 
putations  show  that  in  general,  for  a  fixed  P,  Theorem  1 
allows  for  a  larger  p  than  Corollary  1.  Therefore, 
Theorem  1  offers  a  wider  choice  of  invariant  ellipsoids 
for  optimization  and  will  lead  to  less  conservative  esti¬ 
mation  of  the  domain  of  attraction. 

2.4.  Estimation  of  the  domain  of  attraction 

With  all  the  ellipsoids  satisfying  the  set  invariance  con¬ 
dition,  we  would  like  to  choose  from  among  them  the 
“largest”  one  to  get  a  least  conservative  estimation  of  the 
domain  of  attraction.  In  the  literature  (see,  e.g.,  Boyd, 
El  Ghaoui,  Feron,  &  Balakrishnan,  1994;  Davison  & 
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Kurak,  1971;  Pittet  et  al,  1997),  the  largeness  of  an  el¬ 
lipsoid  is  usually  measured  by  its  volume.  Here,  we  will 
take  its  shape  into  consideration.  Let  Zr  C  R"  be  a  pre¬ 
scribed  bounded  convex  set.  For  a  set  S  C  R",  define 


aR(£):=sup{a  >  0:  ocZR  C  S }. 

If  ocK(S)  S?  1,  then  ZR  C  S .  Two  typical  types  of  ZR  are 
the  ellipsoids 

XK  =  £(R,\)  =  {xe'Rn:x1Rx^  1},  R  >  0 


and  the  polyhedrons 

ZR  =  co{x1,x2,...,xz}, 

where  “co”  denotes  the  convex  hull. 

Theorem  1  gives  a  condition  for  an  ellipsoid  to  be 
inside  the  domain  of  attraction.  Now  we  would  like  to 
choose  from  all  the  S (P,  />)’ s  that  satisfy  the  condition 
such  that  the  quantity  aR(<?(P,p))  is  maximized.  This 
problem  can  be  formulated  as 


sup  a 

P>0,pH 

s.L  (a)  ccYr  Cf(P,p), 

(b  )(A  +  BM(v,F,H)?P  (7) 

+P(A  +  BM(y,F,H ))  <  0  Vver, 


(c)  <?(P,p)  C 

If  we  replace  a  with  logdet(P/p)-1  and  remove  con- 
straint  (a),  then  we  obtain  the  problem  of  maximizing  the 
volume  of  <^(P,  p).  Similar  modification  can  be  made  to 
other  optimization  problems  to  be  formulated  in  this  pa¬ 
per.  Moreover,  the  following  procedure  to  transform  (7) 
into  a  convex  optimization  problem  with  LMI  constraints 
can  be  adapted  to  the  corresponding  volume  maximiza¬ 
tion  (or  minimization)  problems. 

Now  we  transform  the  constraints  of  (7)  into  LMIs. 
If  Zr  is  a  polyhedron,  then  by  Schur  complement,  (a)  is 
equivalent  to 


<  i 


•  j_ 
a2 


Xi 


(8) 


for  all  i  £  [1,  /].  If  XR  is  an  ellipsoid  £{R,  1),  then  (a)  is 
equivalent  to 


Constraint  (b)  is  equivalent  to 
,  (jj  '  (A  +  BM(v,F,H))r 

+  (A  +  BM(v,F,H))  (£) 


<0  VvGtT 


(10) 


From  Hindi  and  Boyd  (1998),  constraint  (c)  is  equivalent 
to 


>0  (11) 


for  all  i€[l,m].  Let  y=l/a2,Q=(P/p)~i  and  G  = 
H{P/p)~l.  Also  let  the  ith  row  of  G  be  <?,,  i.e., 
9i  =  hi(P/p)~l.  Note  that M(v,F,H)Q =M(y,FQ,HQ)  = 
M(v,FQ,G).  If  Xr  is  a  polyhedron,  then  from  (8), (10) 
and  (11)  optimization  problem  (7)  can  be  rewritten  as 


inf  y 
q>o,g 

s.t.  (al) 


y  x; 
xi  Q 


>0,  i  £  [1,  /], 


(b)  QAr+AQ  +  M(y, FQ,  G)rBT 
+BM(v,FQ,  G)  <  0  Vv  £  r, 


(c) 


1  9: 

gj  Q 


$s0,  i£[l,m], 


(12) 


where  all  the  constraints  are  given  in  LMIs.  If  Xr  is  an 
ellipsoid,  we  just  need  to  replace  (al)  with 


(a2) 


yR 

I 


Note  that  there  are  2m  matrix  inequalities  in  constraint 
(b)  corresponding  to  all  v  £  'f. 


Example  1.  We  use  an  example  of  Pittet  et  al.  (1997)  to 
illustrate  our  results.  The  system  is  described  by  (3)  with 


F=[- 2  -1], 


Withxi  =  [—1  0.8]t  and2fR  =  co{xj,  -Xi},  we  solve  (12) 
and  get  a*  — l/(y*)1/2  =  4.3711.  The  maximal  ellipsoid 
is  <f(P*,l), 


0.1170  0.0627 

0.0627  0.0558 


(see  the  solid  ellipsoid  in  Fig.  1 ).  The  inner  dashed  el¬ 
lipsoid  is  an  invariant  set  obtained  by  the  circle  criterion 
method  in  Pittet  et  al.  (1997)  and  the  region  bounded  by 
the  dash-dotted  curve  is  obtained  by  the  Popov  method, 
also  in  Pittet  et  al.  (1997).  We  see  that  both  the  regions 
obtained  by  the  circle  criterion  and  by  the  Popov  method 
can  be  actually  enclosed  in  a  single  invariant  ellipsoid. 

To  get  a  better  estimation,  we  vary  xi  over  a  unit  circle, 
and  solve  (12)  for  each  X\ .  Let  the  optimal  a  be  a*(xi). 
The  outermost  dotted  boundary  in  Fig.  1  is  formed  by  the 
points  a*(xi)x!  as  x\  varies  along  the  unit  circle. 
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3.  Disturbance  rejection 

3.1.  Problem  statement 

Consider  the  open-loop  system 

x=Ax  +  Bg(u)  +  Ew,  jeeR”,  h€R",  wgR9, 

(15) 

where,  without  loss  of  generality,  we  assume  that  the 
bounded  disturbance  w  belongs  to  the  set 

if  :=  {w:  w(t)rw(t)  ^  1  V/  ^  0}. 

Let  the  state  feedback  be  u=Fx.  The  closed-loop 
system  is 


Fig.  1.  The  invariant  sets  obtained  with  different  methods. 


2.5.  Controller  design 

Now  our  objective  is  to  choose  a  feedback  matrix 
Fe  Rmx"  such  that  the  estimated  domain  of  attraction  as 
obtained  by  the  method  of  the  last  subsection  is  maxi¬ 
mized  with  respect  to  X R.  This  can  be  simply  done  by 
taking  the  F  in  (12)  as  an  extra  optimization  parameter. 
To  make  the  optimization  easy,  we  use  a  new  parameter 
Y  to  replace  FQ  in  (12)  and  the  resulting  LMI  problem  is 


inf  y 

Q>OtY,G 

s.t.  (12al),(12c)  and 


(b)  QAr  +AQ  +  M(y,  Y,  G)TBr 
+BM(v,Y,G)<  0,  Vv  €  ir. 


(13) 


The  optimal  F  will  be  recovered  from  YQ  1 .  Consider  a 
simpler  optimization  problem 


inf  y 
B>0.G 

s.t.  (12al),(12c)  and 

(b)  QAt+AQ+GtBt  +  BG<0. 


(14) 


If  Y—G,  then  all  the  2m  inequalities  in  (13b)  are  the 
same  as  (14b).  Hence  the  new  problem  (14)  can  be  con¬ 
sidered  as  a  result  from  forcing  Y  =  G  in  (13).  On  this 
account,  (14)  should  have  an  inftmum  no  less  than  (13). 
On  the  other  hand,  since  the  2m  inequalities  in  (13b)  in¬ 
clude  (14b),  problem  (14)  can  also  be  considered  as  a 
result  from  discarding  2m  —  1  inequality  constraints  of 
(13b).  Because  of  this,  (14)  should  have  an  infimum  no 
larger  than  (13).  These  arguments  show  that  the  optimal 
values  of  (14)  and  (13)  must  be  the  same.  From  the  above 
analysis,  we  see  that,  if  our  only  purpose  is  to  enlarge  the 
domain  of  attraction,  we  might  as  well  solve  the  simpler 
optimization  problem  (14).  The  freedom  in  choosing  Y 
can  be  used  to  improve  other  performances  beyond  large 
domain  of  attraction. 


x=Ax  +  Ba(Fx)  +  Ew.  (16) 

For  an  initial  state  x(0)  =x0,  denote  the  state  trajectory 
of  the  closed-loop  system  under  w  as  \j/(t,xo,w).  A  set  in 
R”  is  said  to  be  invariant  if  all  the  trajectories  starting 
from  it  will  remain  in  it  regardless  of  w  e  if.  An  ellipsoid 
&{P,p)  is  said  to  be  strictly  invariant  \tV  —  2xrP(Ax  -f 
Ba(Fx )  +  Ew)  <  0  for  all  w  such  that  wTw  ^  1  and  all 
xe  dS(P,  p ),  the  boundary  of  £{P,p).  The  notion  of  in¬ 
variant  set  plays  an  important  role  in  studying  the  stability 
and  other  performances  of  a  system  (see,  e.g.,  Blanchini, 
1994;  Boyd  et  al.,  1994  and  the  references  therein). 

Our  primary  concern  is  the  boundedness  of  the  trajec¬ 
tories  for  some  set  of  initial  states  (may  be  as  large  as 
possible).  This  requires  a  large  invariant  set.  On  the  other 
hand,  for  the  purpose  of  disturbance  rejection,  we  would 
also  like  to  have  a  small  invariant  set  containing  the  ori¬ 
gin  in  its  interior  so  that  a  trajectory  starting  from  the 
origin  will  stay  close  to  the  origin. 

To  formally  state  the  objectives  of  this  section,  we 
need  to  extend  the  notion  of  the  domain  of  attraction  as 
follows. 

Definition  1.  Let  03  be  a  bounded  invariant  set  of  (16). 
The  domain  of  attraction  of  03  is 

Sf{03)\ =  ix0eR":  lim  d(\l/(t,xo,w),08)  =  O  "iweif^, 

t — >00 

where  d(\j/(t ,  xo,w),^)  =  infx€^  ||^(/,  xo ,w)  —x\\  is  the 
distance  from  \l/(t,  x0,w)  to  03. 

The  problems  we  are  to  address  in  this  section  are  given 
as  follows: 

Problem  1  (Set  invariance  analysis). 

Let  F  be  known.  Given  an  ellipsoid  ^(P,  p),  determine 
if  $(P,p)  is  (strictly)  invariant. 

Problem  2  (Invariant  set  enlargement). 

Given  a  bounded  set  X0  C  R”,  design  F  such  that  the 
closed-loop  system  has  an  invariant  set  0(P,  p)  D  cc2Xq 
with  ot2  maximized. 
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Problem  3  (Disturbance  rejection). 

Given  a  set  Xoo  C  R”,  design  F  such  that  the 
closed-loop  system  has  an  invariant  set  <?(P,p)  C  a$Xt 
with  a3  minimized. 

Problem  4  (Disturbance  rejection  with  guaranteed  do¬ 
main  of  attraction). 

Given  two  reference  sets,  and  Xq ,  design  F  such 
that  the  closed-loop  system  has  an  invariant  set  S (P,  1 )  D 
X0 ,  and  for  all  x0  €  £(P,  1 ),  ^(t3x0i  w)  will  enter  a  smaller 
invariant  set  £{P<,pi)  C  ouXoo  with  a4  minimized. 

5.2.  Condition  for  set  invariance 

We  consider  closed-loop  system  (16)  with  a  given  F. 
The  following  theorem  gives  a  sufficient  condition  for  the 
invariance  of  a  set  <?(P,  p).  . 

Theorem  2.  For  a  given  set  <?(P,p),  if  there  exist  an 
He  Rmxn  and  a  positive  number  tj  such  that 

(A  +  BM(v,F,H))tP  +  P(A  +  BM(y,F,H)) 

+  -PEEJP  -f  -P  <  0(  <  0)  Vv  e  r  (17) 

n i  p 

and  £(P,p)  C  2(H),  then  £(P,p)  is  a  ( strictly )  invari¬ 
ant  set  for  system  (16). 

Proof.  We  prove  the  strict  invariance.  That  is,  for 
V(x)=xTPx,  we  will  show  that 

V  =  2 xtP(Ax  +  Ba(Fx)  +  Ew)  <  0 

for  all  x  e  8£(P,p)  and  all  w  such  that  wTw  <  1.  Follow¬ 
ing  the  procedure  of  the  proof  of  Theorem  1 ,  we  can  show 
that  for  every  x  €  £(P,  p),  there  exists  avef  such  that 

2xTP(Ax  +  Bo(Fx))  <  2xT(A  +  BM(v,  F,H)fPx. 

Since 

2 xtPEw  ^  lxJPEErPx  +  r]wrw 
V 

<  -xrPEETPx  + r\ 

n 

we  have 

V^xr  (l(A  +  BM(v,F,H))rP  +  ^PEETP^  x  +  p 

It  follows  from  (17)  that  for  all  x  e  £(P,  p), 

V  <  —  -xTPx  +  jj. 

P 

Observing  that  on  the  boundary  of  <f(P,p),xTPx==p, 
hence  V  <  0.  It  follows  that  <f  (P,  p)  is  a  strictly  invariant 
set.  □ 

Theorem  2  deals  with  Problem  1  and  can  be  easily  used 
for  controller  design  in  Problems  2  and  3.  For  Problem 


2,  we  can  solve  the  following  optimization  problem: 
sup  a2 

P  >  0,  ptrj  >  OpyH 

s.t.  a2Xo  c£(P,p),  (18) 

S(P,p)  C  2(H)  and  (17). 

Let  Q  =  (P/p)~',  Y  =  FQ  and  G  =  HQ,  then  (17)  is 
equivalent  to 

QA1  +  AQ  +  M(v,  Y,  G)rBr  +  BM(v,  Y,  G) 

+  P-EE1  -b-Q  <  0  VvoT  . 

V  P 

If  we  fix  p/t],  then  the  original  optimization  constraints 
can  be  transformed  into  LMIs  as  with  (7).  The  global 
maximum  of  a2  will  be  obtained  by  running  p/rj  from  0 
to  oo.  For  Problem  3,  we  have 

inf  0(3 

P>0tp^j>0fFfH 

S.t.  S(P,p)C(tlX<x>,  (19) 

£(P,p)  C  2(H)  and  (17), 

which  can  be  solved  similarly  as  Problem  2. 

3.3.  Disturbance  rejection  with  guaranteed  domain  of 
attraction 

Given  c  R",  if  the  optimal  solution  of  Problem  2 
is  aj  >  1,  then  there  are  infinitely  many  choices  of  the 
feedback  matrices  F  ’  s  such  that  Xq  is  contained  in  some 
invariant  ellipsoid.  We  will  use  this  extra  freedom  for  dis¬ 
turbance  rejection,  that  is,  to  construct  another  invariant 
set  £(P,  p\ )  which  is  as  small  as  possible  with  respect  to 
some  Xoo.  Moreover,  X0  is  inside  the  domain  of  attraction 
of  £(P,  p\ ).  In  this  way,  all  the  trajectories  starting  from 
Xq  will  enter  §(P,p\)  C  04X00  for  some  04  >  0.  Here 
the  number  04  is  a  measure  of  the  degree  of  disturbance 
rejection. 

Before  addressing  Problem  4,  we  need  to  answer  the 
following  question:  Suppose  that  for  given  F  and  P, 
both  £(P,pi )  and  £(P,pi),p\  <  p2  are  strictly  invari¬ 
ant,  then  under  what  conditions  will  the  other  ellipsoids 
£(P,p),p€  (pi,pz)  also  be  strictly  invariant?  If  they  are, 
then  all  the  trajectories  starting  from  within  S(P,p2)  will 
enter  £(P,  pi )  and  remain  inside  it. 

Theorem  3.  Given  two  ellipsoids,  £(P, pi )  and £(P, p2), 
p2>  p,  >  0,  if  there  exist  HuH2e  Rmxn  and  a  positive 
number  q  such  that 

(A  +BM(v,F,Hi))TP  +  P(A  +BM(v,F,Hi)) 

+  -PEErP  +  —P  <  0  Vve-T,  (20) 

n  Pi 
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(A  +  BM(y,F,Hi)?P  +  P(A  +  BM(v,F,H2 )) 

+  lpEErP  +  —P<  0  Vvet"  (21) 

n  p2 

and  £{P,  p\ )  C  -£?(i7j ),  <f(P,p2)  C  S£(H2),  then  for  ev¬ 
ery  p  £  [pi,  p2],  t/zem  exists  an  11  £  Rm x "  suc/i  that 

(A  +  BM(v,F,H))tP  +  P(A  +  BM(v,F,H )) 

+  lpEETP  +  ^P<  0  Vv  e  r  (22) 

rj  p 

and  £{P,  p)  £  SC(H).  This  implies  that  £(P,  p)  is  also 
strictly  invariant. 


Proof.  Let  h\ti  and  h2ii  be  the  z'th  row  of  Hi  and  H2 
respectively.  The  conditions  £{P,p\)  c  SP{H\)  and 
£{P,p2)  C  -S?(Pf2)  are  equivalent  to 


z'e[l,m]. 


Fig.  2.  The  invariant  ellipsoids  and  the  null  controllable  region. 


Example  2.  The  open-loop  system  is  described  by  (15) 
with 


Since  p  £  [pi,p2],  there  exists  a  2e[0, 1]  such  that 
1/p  — 2(l/pi)  +  (1  -  X)/p2.  Let  H  =  Mi+(  1  -  X)H2. 
Clearly 


From  (20)  and  (21 ),  and  by  convexity,  we  have  (22).  □ 


The  system  has  a  pair  of  unstable  complex  poles.  We 
first  ignore  the  disturbance  and  solve  (13)  for  a  feedback 
with  the  objective  of  maximizing  the  domain  of 
attraction  with  respect  to  the  unit  ball,  Xr  =  £(1, 1 ).  The 
result  is, 

«*  =  1/Cy*)1/2  =  2.4417, 

[  0.0752  -0.0566' 

—  [  —0.0566  0.1331  J’ 


In  view  of  Theorem  3,  to  solve  Problem  4,  we  only  need 
to  construct  two  invariant  ellipsoids  £(P,  p\ )  and  S'{P,  p2  ) 
satisfying  the  condition  of  Theorem  3  such  that  Xq  c 
£(P,p2)  and  £(P,pi)  C  with  a4  minimized.  Since 
p2  can  be  absorbed  into  other  parameters,  we  assume  for 
simplicity  that  p2  =  1  and  p\  <  1.  Problem  4  can  then  be 
formulated  as 

inf  a4 

p  >  0,0  </)i  <  >  o/y/i  Jh, 

s.t.  (a)X0cA-P,l)» 

£(P,pl)C  OttXoo, 

(b)  (20),  (21) 

(c)  £(p,Pi)  c  nui), 

(d)  £(P,  1)  C  i?(W2). 

(23) 

If  we  fix  pi  and  t] ,  then  (23)  can  also  be  transformed 
into  a  convex  optimization  problem  with  LMI  constraints. 
To  obtain  the  global  infimum,  we  may  vary  pi  from  0  to 
1  and  t]  from  0  to  oo. 


F;  =  [ -0.0025  -0.2987] 

and  the  invariant  ellipsoid  is  £(P*,  1)  (see  the  larger 
ellipsoid  in  Fig.  2).  As  a  comparison,  we  also  plotted 
the  boundary  of  the  null  controllable  region  (Hu  &  Lin, 
2001a)  of  the  open-loop  system  (see  the  dashed  outer 
curve). 

We  next  deal  with  Problem  2.  By  solving  (18)  with 
Xo  being  a  unit  ball,  we  obtain  aj  =2.3195,  with 
>72  =  0.019.  The  resulting  invariant  ellipsoid  is  S(P2, 1 ), 
with 

[  0.0835  -0.0639' 

[-0.0639  0.1460 

(see  the  inner  dash-dotted  ellipsoid  in  Fig.  2). 

To  deal  with  Problem  3,  we  solve  (19),  with  Xoo  also 
being  a  unit  ball.  We  obtain  a.*  =  0.0606,  which  shows 
that  the  disturbance  can  be  rejected  to  a  very  small  level. 
Now  we  turn  to  Problem  4.  The  optimization  result  by 
solving  Problem  2  gives  us  some  guide  in  choosing 
X0.  Here  we  choose  X0  =  <?(/,22),  Xx  =  £{f  1 ).  The 
optimal  solution  is  a%  =  0.9725,  if  —  0.006,  p*  =0.0489, 
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Fig.  3.  The  invariant  ellipsoids  and  a  trajectory. 


F;  =  [0.2844  -  1.4430],  and 

0.1145  -0.09221 

-0.0922  0.1872  * 

In  Fig.  3,  the  larger  ellipsoid  is  £ {P^ ,  1 ),  the  smaller  ellip¬ 
soid  is  £(P%,  Pi )  and  the  outermost  dashed  closed  curve  is 
the  boundary  of  the  null  controllable  region.  A  trajectory 
is  plotted  with  Xq  G  d£(P^,  1 )  and  w  =  sign(sin(0.3?))* 

4.  Conclusions 

We  considered  linear  systems  subject  to  actuator  sat¬ 
uration  and  disturbance.  A  condition  for  determining  if 
a  given  ellipsoid  is  contractively  invariant  was  derived 
and  shown  to  be  less  conservative  than  the  existing  con¬ 
ditions  that  are  based  on  the  circle  criterion  or  the  vertex 
analysis.  With  the  aid  of  this  condition,  we  developed 
analysis  and  design  methods,  both  for  closed-loop  sta¬ 
bility  and  disturbance  rejection.  Examples  were  used  to 
demonstrate  the  effectiveness  of  these  methods. 
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Stability  Analysis  of  Linear  Time-Delay  Systems  Subject  to 
Input  Saturation 

Yong-Yan  Cao,  Zongli  Lin,  and  Tingshu  Hu 

Abstract—? This  paper  is  devoted  to  stability  analysis  of  linear  sys¬ 
tems  with  state  delay  and  input  saturation.  The  domain  of  attraction 
resulting  from  an  a  priori  designed  state  feedback  law  is  analyzed  using 
Lyapunov-Razumikhin  and  Lyapunov-Krasovskii  functional  approach. 
Both  delay-independent  and  delay-dependent  estimation  of  the  domain  of 
attraction  are  presented  using  the  linear  matrix  inequality  technique.  The 
problem  of  designing  linear  state  feedback  laws  such  that  the  domain  of 
attraction  is  enlarged  is  formulated  and  solved  as  an  optimization  problem 
with  LMI  constraints.  Numerical  examples  are  used  to  demonstrate  the 
effectiveness  of  the  proposed  design  technique. 

Index  Terms — Actuator  saturation,  domain  of  attraction,  linear  matrix 
inequality,  time-delay. 

I.  Introduction 

Nonlinear  systems  with  time-delay  constitute  basic  mathematical 
models  of  real  phenomena,  for  instance,  in  circuits  theory,  economics 
and  mechanics.  Not  only  dynamical  systems  with  time-delay  are 
common  in  chemical  processes  and  long  transmission  lines  in  pneu¬ 
matic,  hydraulic,  or  rolling  mill  systems,  but  computer  controlled 
systems  requiring  numerical  computation  have  time-delays  in  control 

tDps.  The  presence  of  time-delays  in  control  loops  usually  degrades 
stem  performance  and  complicates  the  analysis  and  design  of 
feedback  controllers.  Stability  analysis  and  synthesis  of  retarded 
systems  is  an  important  issue  addressed  by  many  authors  and  for 
which  surveys  can  be  found  in  several  monographs  (see  e.g.,  [7],  [9], 
[10],  [13],  [17],  [20]). 

Another  common,  but  difficult,  control  problem  is  to  deal  with  actu¬ 
ator  saturation  since  all  control  devices  are  subject  to  saturation  (lim¬ 
ited  in  force,  torque,  current,  flow  rate,  etc.).  The  analysis  and  synthesis 
of  controllers  for  dynamic  systems  subject  to  actuator  saturation  have 
been  attracting  increasingly  more  attention  (see,  for  example,  [1],  [1 1], 
[14],  [15]  and  the  references  therein). 

Actuator  saturation  and  time-delays  are  often  observed  together  in 
control  systems.  To  deal  with  both  problems  effectively,  appropriate 
design  methods  are  required.  Up  to  now,  only  a  few  methods  were 
reported  to  deal  with  these  problems  simultaneously.  Chen  et  al  [5] 
studied  the  stabilization  problem  of  saturating  time-delay  system  with 
state  feedback  and  sampled-state  feedback  and  they  derived  several  suf¬ 
ficient  conditions  to  ensure  the  system  stability  in  terms  of  norm  in¬ 
equalities.  Chou  et  al  [6]  exploited  a  sufficient  condition  to  stabilize 
a  linear  uncertain  time-delay  system  containing  input  saturation.  The 
problem  of  robust  stabilization  of  uncertain  time-delay  systems  con¬ 
taining  a  saturating  actuator  was  addressed  by  Niculescu  et  al  [1 6]  by  a 
high  gain  approach.  Oucheriah  [18]  considered  a  method  to  synthesize 
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a  globally  stabilizing  state  feedback  controller  by  means  of  an  asymp¬ 
totic  observer  for  time-delay  systems.  In  [19],  a  dynamic  anti -windup 
method  was  presented  for  the  systems  with  input  delay  and  saturation. 
All  of  these  works  have  mainly  focused  on  the  stabilizability  of  the  sys¬ 
tems. 

In  this  paper,  we  will  first  analyze  the  stability  and  domain  of  at¬ 
traction  for  linear  systems  with  time-delay  in  state  and  actuator  satu¬ 
ration.  A  less  conservative  estimate  of  the  domain  of  attraction  will  be 
derived  based  on  the  Lyapunov-Razumikin  and  Lypunov-Krasovskii 
functional  approaches.  This  estimate  is  then  maximized  over  the  choice 
of  the  feedback  gains.  It  is  known  that  the  estimates  of  the  domain  of 
attraction  made  by  small  gain  theorem,  Popov  criterion  or  circle  crite¬ 
rion  are  sometimes  very  conservative.  In  [12],  a  less  conservative  anal¬ 
ysis  approach  is  proposed  to  analyze  the  stability  and  the  domain  of 
attraction  for  systems  with  actuator  saturation.  The  idea  is  to  formu¬ 
late  the  analysis  problem  into  a  constrained  optimization  problem  with 
constraints  given  by  a  set  of  linear  matrix  inequalities  (LMI’s).  In  this 
paper,  we  will  further  exploit  the  idea  in  [12]  to  arrive  at  an  estimate 
of  the  domain  of  attraction  for  the  linear  systems  subject  to  both  delay 
in  state  and  actuator  saturation.  An  LMI  optimization  approach  will  be 
proposed  to  design  the  state  feedback  gain  which  maximizes  this  esti¬ 
mate  of  the  domain  of  attraction. 

The  paper  is  organized  as  follows.  Section  II  gives  some  preliminary 
results  and  states  more  precisely  our  problem  formulation.  Delay-de- 
pendent  and  delay-independent  stability  and  domain  of  attraction  of 
the  closed-loop  system  with  input  saturation  and  state  delay  will  be 
analyzed  in  Sections  m  and  IV  respectively.  Numerical  examples  il¬ 
lustrating  our  design  procedure  and  its  effectiveness  are  given  in  Sec¬ 
tion  V.  The  paper  is  concluded  in  Section  VI. 

Notations:  The  following  notations  will  be  used  throughout  the 
paper.  R  denotes  the  set  of  real  numbers,  R+  denotes  the  set  of  non¬ 
negative  real  numbers,  Rn  denotes  the  n  dimensional  Euclidean  space 
and  Rmxn  denotes  the  set  of  all  m  x  n  real  matrices.  The  notation 
X  >  Y  (respectively,  X  >  Y),  where  X  and  Y  are  symmetric 
matrices,  means  that  X  -  Y  is  positive  semidefinite  (respectively, 
positive  definite).  Cn,r  =  C([— r,0],Rn)  denotes  the  Banach  space 
of  continuous  vector  functions  mapping  the  interval  [-r,  0]  into 
Rn  with  the  topology  of  uniform  convergence.  The  following  norms 
will  be  used:  ||  *  ||  refers  to  either  the  Euclidean  vector  norm  or  the 
induced  matrix  2-norm;  \\<f>\\c  =  suP-r<<<o  li^WII  stands  for  the 
norm  of  a  function  <j>  e  Cn,r.  Moreover,  we  denote  by  C”jT  the  set 
Cn,r  =  {<£  €  Cn,T*  Me  <  where  v  is  a  positive  real  number. 

II.  Problem  Statement  and  Preliminaries 
A.  Problem  Statement 

Let  us  consider  the  linear  system  with  time-delay  in  state  and  input 
saturation 

x(t)  —Ax(t)  -f*  Adx(t  -  t)  +  Ba(u(t))  (1) 

x(t)=ip(t),  t  e  [-r,  o]  (2) 

where  x  £  Rn  is  the  state,  u  £  Rm  the  control  input,  r  a  constant  and 
A ,  Ad  and  B  are  known  matrices.  Assume  that  the  initial  condition  ^ 
is  a  continuous  vector- valued  function,  i.e ^  E  Cn,T.  The  function 
a\  Rm  — ►  Rm  is  the  standard  saturation  function  defined  as  follows: 

a(u)  =  [<r (z^i)  a(u2)  ■  •  •  (r(urn)]T 
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where  cr(ui)  =  sign(u;)  min{l,  |u*|}.  Here  we  have  slightly  abused 
the  notation  by  using  <r  to  denote  both  the  scalar  valued  and  the  vector 
^lued  saturation  functions.  Also,  note  that  it  is  without  loss  of  gener¬ 
ality  to  assume  unity  saturation  level.  We  use  xt  £  Cn,r  to  denote  the 
restriction  of  x(t)  to  the  interval  [t  —  r,  t]  translated  to  [— t,  0],  that  is, 
xt(9)  =  x(t  +  9),  9  £  [  t ,  0]. 

In  this  paper,  we  consider  the  control  of  the  system  (1)  using  a  linear 
state  feedback  u  =  Fx.  The  closed-loop  system  under  this  feedback 
is  given  by 

x(t)  =  Ax(t)  +  Adx{t  —  r)  +  Ba  (Fx(t)) ,  x0  =  ip  E  Cn,r .  (3) 

We  will  be  interested  in  the  stability  analysis  and  design  for  (3).  For 
an  initial  condition  x0  E  C„|T ,  denote  the  state  trajectory  of  the  system 
(3)  as  x(t,  xo).  Suppose  that  the  solution  x(£)  =  0  is  asymptotically 
stable,  then  the  domain  of  attraction  of  the  origin  is 

S  :=  jso  G  Cny-  Im^xfaxo)  =  oj  . 

A  set  A'  C  Cntr  is  said  to  be  invariant  if 

xq  £  X  =>  xt  £  X  Vt  >  0. 

In  general,  given  a  stabilizing  state  feedback  u  =  Fx,  it  is  impossible 
to  determine  exactly  the  domain  of  attraction  of  the  origin.  The  objec¬ 
tive  of  this  paper  is  to  obtain  an  estimate  of  the  domain  of  attraction  for 
(3).  The  problems  to  be  studied  in  this  paper  are  the  following. 

Problem  1:  Given  a  state  feedback  matrix  F  and  a  set  of  initial  con¬ 
ditions  V ,  determine  if  V  C  <S. 

Problem  2:  Design  an  F  such  that  an  estimate  of  the  domain  of 
attraction  is  maximized. 

.  Razumikhin  Theorem  and  Krasovskii  Theorem 

For  stability  analysis  of  systems  with  time-delay,  the  Razumikhin 
Theorem  and  Krasovskii  Theorem  are  used  extensively.  In  what  fol¬ 
lows,  we  give  a  brief  summary  of  the  two  theorems  simplified  to  au¬ 
tonomous  systems. 

Consider  the  retarded  functional  differential  equation 

x(t)  =/(xt),  t  >  0  (4) 

x(t)=^(f),  t  £  [— r,  0].  (5) 

Assume  that  ip  £  CntT  and  the  map  f(ip):  Cn,T  * — *  Rn  is  contin¬ 
uous  and  Lipschitzian  in  ip  and  /( 0)  =  0.  Also  denote  the  solution  of 
the  functional  differential  (4)  with  the  initial  condition  xo  G  C„,r  as 
x(t,  xo). 

Definition  1:  The  trivial  solution  x(t)  =  0  of  (4)  and  (5)  is  said  to 
be  asymptotically  stable  if 

1)  for  every  6  >  0  there  exists  an  e  =  e(6)  such  that  for  any  ip  £ 
B( 0,  e)  the  solution  x(f,  ip)  of  (4)  and  (5)  satisfies  xt  £  B{ 0, 6) 
for  all  t  >  0. 

2)  for  every  rj  >  0  there  exist  a  T(rj)  and  a  vo  >  0  independent  of 
7}  such  that  ip  £  B( 0,  vQ)  implies  that  ||xt||c  <  *7,  Vf  >  F(t/). 

The  Krasovskii  Theorem  and  the  Razumikhin  Theorem  give  condi¬ 
tions  for  x(t)  =  0  to  be  asymptotically  stable.  Actually,  more  informa¬ 
tion  about  invariant  set  and  regional  stability  is  contained  in  the  proofs 
for  these  theorems  in  [9].  The  additional  information  is  incorporated  in 
the  following  statement  of  these  theorems. 

Theorem  1  (Krasovskii  Stability  Theorem):  Suppose  that  the  func¬ 
tion  /:  Cn,r  * — ♦  FT  takes  bounded  sets  of  Cn,r  in  bounded  sets  of 
and  suppose  that  u(s ),  v(s)  and  u>(s)  are  scalar,  continuous,  pos¬ 
itive  and  nondecreasing  functions.  If  there  is  a  continuous  function 
V:  Cntr  i — *  R+  and  a  positive  number  p  such  that  for  all  xt  £ 
Ly{p)  :=  {ip  £  Cn,r  :  V(ip)  <  p},  the  following  conditions  hold. 

1)  tt(M0)||)  <  V(xt)  <  v(\\xt\\c). 

2)  V(xt)  <  -TI7(||Xf(0)||). 


Then,  the  solution  x(i)  =  0  of  the  (4)  and  (5)  is  asymptotically  stable. 
Moreover,  the  set  Lv  (p)  is  an  invariant  set  inside  the  domain  of  attrac¬ 
tion. 

Theorem  2  (Razumikhin  Stability  Theorem):  Suppose  that  u(s), 
v(s),  w(s)  and  p(s)  £  R+  i — >  R+  are  scalar,  continuous  and 
nondecreasing  functions,  u(s),  v(s ),  w(s)  positive  for  s  >  0, 

u(0)  =  v(0)  =  0  and  p(s)  >  s  for  s  >  0.  If  there  is  a  continuous 
function  V :  Rn  i — *  R  and  a  positive  number  p,  such  that  for  all 
xt  G  Mv(p)  :=  {ip  G  C„,r:  V(ip(0))  <  p,  V(9  €  [-rf0]},  the 
following  conditions  hold. 

1)  «(i|x||)  <  V(x)  <  v(||x||). 

2)  V(x(t))  <  -w(\\x(t)\\),ifV{x{t  +  e))  <  p{V(x(t)))iV9  £ 

[-r,0]. 

Then,  the  solution  x(t)  =  0  of  the  (4)  and  (5)  is  asymptotically  stable. 
Moreover,  the  set  My  (p)  is  an  invariant  set  inside  the  domain  of  at¬ 
traction. 

C  Some  Mathematical  Tools 

Let  fi  be  the  i-th  row  of  the  matrix  F.  We  define  the  symmetric 
polyhedron 

£(F)  =  {x  G  Rn:  I/,-x|  <  1,  *  =  1, . . . ,  m} . 

If  the  controls  does  not  saturate  for  allt  =  m,  that  is  x  £  £(F), 

then  the  nonlinear  system  (3)  admits  the  following  linear  representa¬ 
tion: 

x(t)  =  (A  -4*  BF)x(t)  +  Adx(t  -  r).  (6) 

Let  P  £  RriXn  bea  positive-definite  matrix.  For  a  number  p  >  0,  the 
ellipsoid  ft(P,  p)  is  defined  by 

Cl(P,p)  :=  {x  e  Rn:  xT Px  <  p} . 

Let  V  be  the  set  of  m  x  m  diagonal  matrices  whose  diagonal  elements 
are  either  1  or  0.  Then  there  are  2m  elements  in  V.  Suppose  that  each 
element  of  V  is  labeled  as  Di>  i  =  1, 2, . . . ,  2m  and  denote  D~  = 
I  —  Di.  Clearly,  is  also  an  element  of  V  if  Di  £  V. 

Lemma  1  [11]:  Let  F,  H  G  RmXn  be  given.  For  x  £  R”,  if 
||ffa||ao  <  I,  then 

<r(F*)  G  co  [DiFx  +  DTHx:  i  £  [1, 2m]} 
where  co{ }  denotes  the  convex  hull  of  a  set 
Lemma  2  [3]:  For  any  x,y  £  Rn  and  a  matrix  M  >  0  with  com¬ 
patible  dimensions,  the  following  inequality  holds 
2 xTy  <  xtMx  +  yT M~ly. 

HI.  Delay-Independent  Analysis 

In  this  section,  we  will  give  methods  for  estimating  the  domain  of 
attraction  for  the  system  (3)  with  invariant  sets.  We  will  first  give  con¬ 
ditions  for  a  set  to  be  an  invariant  set  inside  the  domain  of  attraction  and 
then  use  optimization  approach  to  enlarge  the  invariant  set  by  choosing 
the  feedback  gain  matrix  F  and  the  Lyapunov  function. 

A.  Razumikhin  Functional  Approach 

Theorem  3:  Let  F  G  Rm  x  n  be  given.  For  a  positive  definite  matrix 
P  £  Rnxn  and  a  number  p  >  0,  consider  the  set 

Mv ( p )  =  {V>  £  C„y.  i>($)  €  ft(P,  p)  W  G  [-r,  0]} . 

If  there  exist  two  matrices  H  E  Rmxn  and  W  t  Rr‘ x  n ,  W  >  0  such 
that 

(A  +B  {DiF  +  D-H))T  P 
+  P(A  +  B(DiF  +  D-H )) 

+  PAdWAlP  +  P 
<0,  i  €  [1. 2m], 

P  >W~X 


(7) 

(8) 
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and  Q(P,p)  C  C(H)->  i.e.,  \hix\  <  1  for  all  x  £  Cl(P,p),  i  = 
1, 2,. . . ,  m,  then  the  solution  x(t)  =  0  is  asymptotically  stable  for 
he  system  (3)  and  the  set  My  (p)  is  an  invariant  set  inside  the  domain 
of  attraction. 

Proof:  Given  P  >  0,  consider  a  quadratic  Lyapunov  function 
candidate  V(x)  =  xTPx.  First,  we  have  ei\\x\\2  <  V(x)  <  £2||z||2, 
where  E\  —  ^min  (P),£2  =  ^max  (P).  The  derivative  of  V  along  the 
solutions  of  (3)  is 

V(x(t))  =  2x(t)T PAx(t)  +  2xT(t)PAdx(t  -  t) 

42  xT(t)PB<r(Fx(t)). 
In  what  follows,  we  will  be  interested  in  xt  £  Mv(p).  In  this  case, 
x(t)  E  f7(P,  p).  Since  |h;x|  <  1  for  all  x  E  H(P,  p),  t  =  1,2 
by  Lemma  1,  for  every  x(t)  E  H(P,  p) 

<r(Fx(t))  E  co  { (DiF  +  Dfff)  x(t):  i  =  1, . . . ,  2m}  . 

It  follows  that  for  eveiy  x(t)  E  f2(P,  p),  we  have 
V(x(t))  <  ^max^2 xT (t)P  (A  +  jB  ( DiF  +  £>" FT))  x(f) 

H-2xr(t)PAdx(£  —  r). 


From  Lemma  2  and  (8),  we  further  have 


V(x(t)) 


<  max  xT  (t)  (  f 

*£[l,2m] 


(A  -h  £  (DiF  +  Df  ff))  P 
+  P(A  +  B{DiF  +  DrH)) 

+  PAdWA^p]x{t)  +  V(x{t-T)).  (9) 


By  Razumikhin  Theorem,  to  prove  that  My  (p)  is  an  invariant  set  inside 
Jhe  domain  of  attraction,  it  suffices  to  show  that  there  exist  an  e  >  1 
nd  a  <5  >  0  such  that 

V(x(t))<-6V(x(t))9 
if  V(x(t  +  9))  <eV(x(t))  WO  E  [-r,  0].  (10) 

In  the  remainder  of  the  proof,  we  will  construct  such  e  and  6  and  show 
that  they  satisfy  (10). 

From  (7),  we  see  that  there  exists  a  5  >  0  such  that 
(A  +B  (DiF  +  D-H))TP 
+  P(A  +  B(DiF  +  D~H )) 

4  PAdWAdP+(l  +  2S)P 
<0,  i  €  [l,2m]. 

Let  e  =  1  4-  6.  Now  suppose  that  V(x(t  +  6))  <  zV(x(t )),  V0  E 
{ — r,  0].  Then  from  (9),  we  have 


V(x)  <  . ^  xr  [ (A  +  B  (DiF  +  ))  P 

+  P(A  +  B  (ftF 4  !>“#))  +  PAdWAdP 4  eP  )x 
<-6V(x(t)). 


This  completes  the  proof  ■ 

Note  that  the  condition  of  Theorem  3  does  not  include  any  infor¬ 
mation  of  time-delay,  i.e.,  the  theorem  provides  a  delay-independent 
condition  for  regional  stability  of  linear  time-delay  systems  with  input 
saturation  in  terms  of  the  feasibility  of  several  linear  matrix  inequali¬ 
ties.  This  result  can  also  be  easily  extended  to  systems  with  multiple 
time-varying  time-delays  in  state  [2]. 

j  Remark  1:  In  practice,  we  may  be  interested  in  the  stability  region  in 
which  the  asymptotic  stability  of  closed-loop  system  (3)  is  guaranteed 
under  saturation  and  the  linear  closed-loop  system  (6)  (i.e.,  unsaturated 
closed-loop  system)  is  /5 -stable.  As  shown  in  [17],  /5-stability  is  equiv¬ 
alent  to 


which  is  stable.  This  can  be  guaranteed  by  the  following  matrix  in¬ 
equality: 

(A  4  BF)t P 4  P(A  4  BP)  4  e2/?T  PAdWA J P  4  2/JP  <  0.  (1 1 ) 

Remark  2:  If  the  matrix  Ad  is  rank  deficiency,  i.e.  there  exists  a 
decomposition  Ad  =  -DdPd,  wherein  €  RnXp,  Ed  E  RpXn,p  <  n, 
then  we  can  prove  with  similar  arguments  that  My  (p)  is  an  invariant  set 
inside  the  domain  of  attraction  if  there  exist  two  matrices  H  £  Rm  xn 
and  W  E  RpXp  >  0  satisfying  the  matrix  inequalities 

(A  4B  {DiF  +  D-H)f  P 
+  P(A+B(DiF+D-H )) 

4  PDdWDd  P  +  P 
<0,  *e[l,2m],  EjW~1Ed<P. 

With  all  the  My  (p)  satisfying  the  set  invariance  condition,  we  would 
like  to  choose  the  “largest”  one  to  obtain  the  least  conservative  estimate 
of  the  domain  of  attraction  by  the  method  introduced  in  [12].  We  see 
that  the  “size”  of  the  set  My  (p)  is  proportional  to  the  size  of  f2(P,  p) . 
Here  we  would  like  to  take  the  shape  of  f2(P,  p)  into  consideration.  For 
this  purpose,  we  introduced  the  notion  of  shape  reference  set  as  in  [12]. 
Let  Ar  C  Rn  be  a  prescribed  bounded  convex  set  containing  origin. 
For  a  set  S  C  Rn  containing  origin,  define  the  size  of  S  with  respect 
to  Ar  as 


aR(i>)  :=  sup{a  >  0:  aAk  C  5}. 


Obviously,  if  or  (5)  >  1,  then  Ar  C  S.  Two  typical  types  of  Ar  are 
the  ellipsoid 

Ar  =  {x  S  R":  xTRx  <1}  R  >  0 
and  the  polyhedron 

Ar  =  co{xi,x2,...,x/} 

where  X\ ,  x2 , . . . ,  xi  are  some  given  points  in  Rn . 

Theorem  3  gives  a  condition  for  a  set  My  (p)  to  be  inside  the  domain 
of  attraction  for  the  closed-loop  time-delay  system  subject  to  input  sat¬ 
uration  (3).  With  a  given  shape  reference  set,  we  can  choose  from  all  the 
D(P,  p)  ’s  that  satisfy  the  condition  such  that  the  quantity  okr  (H(P,  p)) 
is  maximized.  This  problem  can  be  formulated  as 

sup  a,  s.t. 

а)  aAk  C  ft(F,  p)> 

б)  (A  4  B  {DiF 4  D~H)  f  P 4  P  (A  4  B  {DiF 4  D~H)) 

4  PAdWATd  P  4  P  <  0,  »  €  [1, 2m], 

c)  |/iix|  <  1,  Vx  E  ft(P,  p),  i  £  [l,m].  (12) 

Let  Q  =  (p^P)"1 , 7  =  1/a2  and  G  =  HQ.  With  similar  proce¬ 
dure  as  in  [12],  we  can  transform  the  above  optimization  problem  to  an 
LMI  problem.  That  is,  if  we  substitute  pW  with  W,  then  for  the  case 
that  Ar  is  a  polyhedron,  the  optimization  problem  (12)  can  be  rewritten 
as  follows: 


inf  7, 
W>Q>0,G 


s.t 


a) 


7 

Xi 


T  1 


€[1,1]. 


b)  QAT  +  AQ  +  B  {DiFQ  4  D~G) 

4  {DiFQ  4  D~G)T  Bt  4  AdWAd 
+  Q<0,ie  [l,2m]. 

c)  J r  g]  >  °.  *e[l,m]. 


If  Ar  is  an  ellipsoid,  then  we  need  to  replace  a)  in  (13)  with 
a~2 R  >  p~l  P  R~l  <  7 Q. 


(13) 


y(t)  -  (A  4  BF  4  4  ePrAdy(t  -  r) 
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As  is  proven  in  [12],  for  systems  without  delay,  i.e.t  Ad  =  0,  solving 
the  above  LMI  optimization  problem  will  give  a  less  conservative  es- 
0  Jmate  of  the  domain  of  attraction  than  other  methods  resulting  from, 
for  example,  the  circle  criterion. 

If  the  unsaturated  system  is  required  to  have  some  stability  margin, 
i.e.,  it  is  required  to  be  /5-stable,  based  on  Remark  1 ,  the  additional  LMI 
constraint  (1 1)  needs  to  be  added  to  optimization  problem  (13),  leading 
to  the  following  LMI  optimization  problem: 


inf  7,  s.t 
W>Q>0,G 

a)  b)  and  c)  in  (13). 
d)  QAt  +  AQ  +  BFQ  +  ( BFQf 
+  e2/3TAdWA$  +2/3Q<0. 


(14) 


The  problem  of  designing  a  feedback  matrix  F  such  that  the  estimate 
of  the  domain  of  attraction  is  enlarged  can  be  formulated  by  simply 
taking  the  parameter  F  in  (13)  as  a  variable  for  optimization.  To  do  so, 
we  just  need  to  replace  Y  =  FQ  in  (13b)  with  a  new  varaiable  Y. 


B.  Krasovskii  Functional  Approach 


In  this  subsection,  we  will  consider  the  following  Lyapunov- 
Krasovskii  functional: 

V(xt)  :=  xT(t)Px(t)  +  f  xT(s)Wx(s)ds  (15) 
Jt-T 


where  P  >  0  and  W  >  0.  This  type  of  functional  has  been  widely 
used  for  stability  analysis  of  time-delay  systems  (see,  e.g .,  [9]). 

Theorem  4:  Let  the  feedback  gain  F  e  RmXn  be  given.  For  given 
P,  W  >  0  and  p  >  0,  consider  the  set 

| pv(/>)  =  €  Cn,r:  V'r(0)P^(0)  + 

(16) 


ij)T  (s)Wip(s)ds 


4 


If  there  exists  a  matrix  H  £  RmXn  such  that  we  get  (17)  shown  at  the 
bottom  of  the  page  and  H(P,  p)  C  C{H),  then  the  solution  x(t)  =  0 
of  the  system  (3)  is  asymptotically  stable.  Moreover,  the  set  Ly(p)  is 
an  invariant  set  inside  the  domain  of  attraction. 

Proof:  Consider  the  Lyapunov  functional  given  by  ( 1 5).  First,  we 

have 


eilM0)||2  <  V(xt)  <ea||*,||2 

where  Ei  —  Amin  (P),e  2  =  Amax  (P)  +  rA  max  (W).  Then 
V(xt)  =  xT(t)(ATP  +  PA  +  W)x(t)  +  2 xT(t)PAdx(t  -  r) 

■+2xT(t)PBc(Fx(t))  —  xT(t  —  r)Wx{t  —  r). 


We  will  be  interested  in  xt  G  Lv{p).  In  this  case,  x(t)  £  H(P,  p)  C 
C{E)  and  we  have 

a(Fx(t))  £  co  {(DiF  +  D~ H)  x(t):i  £  [l,2m]}. 

With  similar  arguments  as  in  the  proof  of  Theorem  3,  we  get  the 
second  equation  shown  at  the  bottom  of  the  page  where  fT(t)  = 
[xT(t)  xT(t  —  r)].  Under  the  condition  (17),  there  exists  a  6  >  0 
such  that  we  get  the  third  equation  shown  at  the  bottom  of  the  page. 
It  follows  that 

V(Xt)  <  —6x(t)T Px(t)  <  -6ei||*(t)||l. 


By  Krasovskii  Stability  Theorem,  Lv(p)  is  an  invariant  set  inside  the 
domain  of  attraction.  ■ 

As  an  estimate  of  the  domain  of  attraction,  the  invariant  set  Ly{p) 
in  Theorem  4  depends  not  only  on  the  P  matrix,  but  also  on  an  inte¬ 
gration  over  [— r,  0].  This  makes  the  structure  of  the  set  Lv(p)  much 
more  complicated  than  the  invariant  set  My{p)  in  Theorem  3  based 
on  Lyapunov-Razumikhin  functional  approach.  Hence,  it  is  not  easy  to 
measure  the  size  of  the  set  Ly  ( p ).  Because  of  this,  we  would  like  to 
determine  a  subset  of  Ly  ( p )  which  is  of  a  more  regular  shape,  say,  like 
My(p)  in  Theorem  3. 

Let  z(t)  =  Pl^x(t).  Then 


INIc  =  SUp  ||z(t)|| 
-r<e<o 


=  sup  ("a;r(f)Px(f)>) 

—t<6<0  \  ' 

and  V(xt)  <  (l  +  rAmax  ( P^WP ~1/2))  ||zt|| 


Let 


Pl  l  +  rA^ax^-^WP-i/2)' 


Then,  we  have 

Mffil)  e  Cn,T-  i>(0fp^(9)  <  Pl, 

V(9  G  [-T,0]|  C  Lv(p). 

On  the  other  hand,  let 

c  _ _ P _ 

Amax  (P)  +  rA  max  m 

then  the  ball  B{5)  =  {ip  €  Cny.  ||^||2  <  6}  is  inside  the  domain 
of  attraction.  We  see  that  the  size  of  M(pi)  is  proportional  to  the  size 
offi(P.pi).  With  a  given  Xr,  we  can  choose  from  all  the  P.(P,  pi)’s 


'  (A  +  B  (DiF  +  D~H)f  P  +  P(A  +  B  (D<P  +  D~H))  +  W 

ATdP 


PAd 

-W 


<0,  «e  [i,2m] 


(17) 


V(xt)  <  max  £(t)T 


(A  +  B  ( DiF  +  D~H)f  P  +  P{A  +  B  ( DiF  +  D~H))  +  W 

ATdP 


PAd " 
-W 


m 


■  (A  +  B  (DiF  +  D~H))T  P  +  P  (A  +  B  (D,F  +  D~H ))  +W  PAd 

<  “ 

ATdP  -W 
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such  that  the  quantity  qr (fl(P,  pi))  is  maximized.  This  problem  can 
be  formulated  as  shown  in  (1 8)  at  the  bottom  of  the  page. 

)  As  in  Section  III-A,  we  can  cast  the  problem  into  the  LMI  frame¬ 
work.  Let  Q  =  (p“lP)~1, 7  =  l/a2,G  =  HQ  and  substitute  pW"1 
with  X,  we  can  reduce  the  optimization  problem  (1 8)  to  the  one  with 
LMI  constraints  as  shown  in  (19)  at  the  bottom  of  the  page.  If  Ar  is  an 
ellipsoid,  then  a)  should  be  replaced  with 

a~2R-  (l  +  r Am„  (p~1/2WP~l/2))  j  >0 

(1  +  re )R~1  <7 Q. 

Also,  as  in  Section  m-A,  a  controller  design  problem  can  be  readily 
formulated  by  taking  F  in  (1 9)  as  an  optimizing  parameter. 

IV.  Delay-Dependent  Analysis 

To  reduce  conservativeness  in  the  analysis  when  the  information  on 
the  delay  is  available,  in  this  section,  we  will  establish  a  delay-depen¬ 
dent  stability  result  for  the  time-delay  system  (3)  with  input  saturation. 
For  simplicity,  denote  Ai  A  -b  Ad  +  B(DiF  -f  D~ H). 

Theorem  5:  Let  the  state  feedback  gain  F  be  given.  Consider  the 
ellipsoid  ft(Pt  p).  If  there  exist  matrices  H  £  Rm  x  n ,  Pl  ,  P2  G  Rn  x  n , 
Pi  >  0,  P2  >  0  and  r0  >  0  such  that 

AiTP  +  PAi  +  T0PMP1  +  P*)ATdP+  2t0P 

<0,  »e[l,2m]  (20) 

[A  +  B(DiF  +  DrH)]TPrl  [A  +  B  (DiF  +  D~H )] 

<p,  <6  [1,2™]  (21) 

ATdP^Ad  <P  (22) 

^^j}nd  Cl(P,  p)  C  C{E),  then  x(<)  =  0  of  the  system  (3 )  is  delay-de- 
pendent  asymptotically  stable.  Moreover,  for  any  time-delay  r  <  To 
and  any  initial  condition  xp,  tp(6)  £  H(P,  p),  V0  E  [— t,  0],  we  have 
limt— co  x(t)  —  0. 

Proof:  Since  x(t)  is  continuously  differentiable  for  t  >  0,  using 
the  Leibniz-Newton  formula,  one  can  write 

x(t  —  r)  =x(t)  —  j  x(s)ds 
J  t  —  T 

=x(t)~  f 

J  t—T 

-b  B0”(Px(s))jds 


for  t  >  r.  Thus  the  system  (3)  can  be  rewritten  as 
i(£)  =(A  A  Ad)x(t) 

-  Ad  J  ^4x(s)  A  Adx(s  -  r)  +  B<r(Fx(s))^ds 
-b  Ba(Fx(t)) 

G  [— 2r,0]  (24) 

where  xp  E  Cn,2r.  By  [9],  [21],  the  asymptotic  stability  of  the  above 
system  will  ensure  the  asymptotic  stability  of  the  original  time-delay 
system  (3). 

Choose  the  Lyapunov  functional  candidate  as  V (x(t))  = 
xT(t)Px(t).  To  prove  the  theorem,  it  suffices  to  show  that  x(£)  =  0 
is  asymptotically  stable  for  the  system  (24)  and  that  the  set 

Mv{p)  =  {tf  G  Cn} 2r:  xP(6)  E  0(P,p),  V0  E  [-2r,0]} 

is  an  invariant  set  inside  the  domain  of  attraction.  Here  we  use  xt  to 
denote  the  restriction  of  x(t)  to  the  interval  [t  —  2r,  t]  translated  to 
[-2r,  0],  that  is,  xt(0)  =  x(t  A0),  0  £  [—2 r,  0]. 

We  are  interested  in  xt  £  Mv  ( p ).  In  this  case,  x(t)  £  £l(P,  p)  and 
we  have 

VYx(t))  <2  max  xT  (t)PAix(t) 

t'€[l,2m] 

+  rxT(t)PAd(Pl  +  P2)ATdPx(t) 

/o 

[Ax(t  -b  s)  -b  Bo(Fx(t  -b  s))]T  Pf1 

x  [Ax(t  -b  s)  +  Ba(Fx(t  -b  s))]  ds 

/o 

|xT(t  —  r  +  s)AdPf1  Adx(t  -  r  -f  s)ds. 

By  the  convexity  of  the  function  xT  Pf1x  and  Lemma  1,  we  have 

[Ax(t)  A  B(r(Px(t))]rP1“1[Ax(t)  +  Ba(Fx(t))] 

<  max  x(tf(AAB(DiFADrH))T 
i£[  l,2m] 

•  Pf\A  +  B(DiF  +  D~  H))x{t). 

It  follows  from  (21)  that 
pix(t)  +  B<r(Fx(t))]T 

■Pf1  [Ax(t)  +  Ba(Fx(t))]  <  xT (t)Px(t) 

and  from  (22),  we  have 

(23)  XT (t)Ad  Pf1  Aax(t)  <  xT(t)Px(t). 


jAx(s)  -b  Adx(s  —  t) 


sup  a, 
P>  O.p.H 


S.t 


a)  olX r  C  (P,  Pi)  • 

(A  +  B  ( DiF  +  D~H))T  P  +  P(A  +  B  {DiF  +  D~H ))  +  W  PAd 

b)  [  ATdP  -W 

c)  |7i;x|  <  1,  Vx  6  fi(P, />),  i  £ 


<0,  ieti,2m]- 


(18) 


inf  7,  s.t. 
Q>O,X>0,G,p 


a) 

b) 


T-l 


(1  +  Te)x- 

[(1  +  re)xi  (1  +  te)Q  J 


>0,  Q<eX,  i  £  [1, !]. 


QAt  +  AQ  +  B  {DiFQ  +  D~G)  +  [DiFQ  +  D~G)  BT  +  AdXATd 


Q 


<  0,  i  6  [1,2" 


c)  Constraint  (13c). 


(19) 
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Hence 


+  tx  T(t)PAd(Pi  +  P2)AjPx(t) 


+ 

+ 


J°  V(x(t  +  s))ds 
J  V ( x(t  —  r  +  s))ds. 


(25) 


By  Razumikhin  Theorem,  to  show  that  Mv  (p)  is  an  invariant  set 
inside  the  domain  of  attraction,  it  suffices  to  construct  an  e  >  1  and  a 
6  >  0  such  that 


V(x(t))<-6V(x(t)), 

ifV(x(t  +  0))  <eV(x{t))  VO  E  [-2r,  0].  (26) 


As  in  Section  III-A,  we  can  propose  an  LMI  optimization  method 
for  estimating  the  domain  of  attraction  for  any  given  time-delay  for  the 
system  (3).  If  Ar  is  a  polyhedron,  then  we  have  the  following  opti¬ 
mization  problem  for  estimating  the  domain  of  attraction  for  systems 
with  r  <  T0 


inf  7,  s.t. 
Q>0iP1>0,P2>0,G 


a) 


T 
7 Xi 


>0,  *  =  1,2,...,/ 


Xi  Q  J 

b)  LMI  (27)-(29),  i  E  [l,2n 

c)  Constrain  (13c). 


(30) 


As  usual,  the  analysis  problem  can  be  easily  modified  for  controller 
design  by  taking  F  as  an  optimizing  parameter. 


V.  Numerical  Examples 


Under  the  condition  of  (20),  there  exists  a  6i  >  0  such  that 

AiTP  +  PAi  +  T0PAd  (Pi  +  P2)  ATdP  +  2ro  (1  +  2 6,)  P  <  0, 

*  €  [1, 2m] . 

Let  e  =  1  +  6\.  Suppose  that  U(x(f  —  6))  <  eV(x(t))  VO  E 
[— 2t,  0].  Then  from  (25),  we  have 


Example  1:  Consider  the  example  given  in  [22].  The  system  is  de¬ 
scribed  by  (1 )  with 


A  = 


‘  1 
0.3 
'10' 
1 


'0 

0 


-1 

0 


T  —  1,  Umax  —  15. 


V(x(t))  <2  max  xT (t)PAix(t) 

-f  r0xT(t)PAd(Pl  +  P2)ATdPx{t) 

-f  2 roex(t)T Px(t) 

=  max  xT  ( Af  P  •+•  PAi  *f  roPAd {Pi  +  PpjAd  F 

«€[l,2m]  \ 

+  2r0£pSjx(t) 

<  —  2ro6ix(t)T  Px(t). 


This  completes  our  proof.  _  ■ 

Remark  3:  By  letting  Q  =  pP*1 ,  G  =  HQ  and  Ai  =  A  -b  Ad ,  we 
see  that  the  matrix  inequalities  (20)  to  (22)  are  equivalent  to  the  LMIs 
shown  in  (2iy{29)  at  the  bottom  of  the  page  where  we  have  replaced 
Pi  and  P2  with  Pi/p  and  P2/p. 

Theorem  5  provides  a  delay-dependent  condition  for  regional  sta¬ 
bility  of  linear  time-delay  systems  with  input  saturation  in  terms  of  the 
feasibility  of  several  linear  matrix  inequalities.  This  result  can  also  be 
easily  extended  to  systems  with  multiple  time-varying  time-delays  in 
state  [3].  Note  that  in  the  proof  the  transformation  (23)  is  used  to  trans¬ 
form  the  time-delay  system  with  single  time  delay  to  a  system  with  dis¬ 
tributed  delay.  It  is  shown  in  [8]  that  such  a  transformation  may  incur 
some  additional  dynamics  that  can  be  characterized  by  appropriate  ad¬ 
ditional  eigenvalues.  And  hence,  if  the  smallest  of  such  delays  is  less 
than  the  stability  delay  limit  of  the  original  system,  then  any  stability 
criteria  obtained  using  such  transformation  will  be  conservative. 

Remark  4:  Theorems  4  and  5  can  also  be  strengthened  when  Ad  is 
rank  deficiency  as  in  Remark  2. 


In  [22],  a  feedback  matrix 


F=  [-0.3592  —  0.1421] 


is  obtained  with  local  stability  in  the  ball  B(6)  =  {x  E  Rn:  ||x||2  < 
5}  with  5  =  1.7919  x  103.  As  in  [22],  we  require  that  the  origin  of 
the  saturated  system  be  asymptotically  stable  and  that  the  unsaturated 
system  is  /3 -stable  with  /?  =  1 .  By  Theorem  3  and  solving  optimization 
problem  (14)  with  the  above  control  law  and  a  unit  ball  as  the  reference 
set,  we  obtain 


a  =  47.0626, 


'0.1324  0.0283' 
0.0283  0.4489 


This  means  that  the  asymptotic  stability  of  the  saturated  system  and 
/3 -stability  (/?  =  1)  of  the  unsaturated  system  are  guaranteed  in  the 
ellipsoid  0(P,  1)  which  include  the  ball  B(6)  with  5  =  a2  =  2.2149  x 
103.  Obviously,  this  estimation  is  less  conservative  than  the  result  of 
[22]. 

If  we  only  require  that  the  saturated  system  be  asymptotically  stable, 
i.e.„  P  =  0,  by  Theorem  3,  we  obtain 


a  =  67.0618 


'0.2223  0.0000' 
0.0000  0.2223, 


This  means  that  the  asymptotic  stability  of  the  saturated  time-delay 
system  is  guaranteed  in  the  ellipsoid  0(P,  1)  which  includes  the  ball 
B(8)  with  8  =  a2  =  4.4973  x  103.  This  is  an  estimate  of  the  domain 
of  attraction  of  the  saturated  time-delay  system.  Note  that  this  estimate 
of  the  domain  of  attraction  is  delay-independent,  i.e.,y  it  holds  for  any 
size  of  time-delay.  This  ellipsoid  f2(P,  1)  is  shown  in  Fig.  1.  The  dot- 


QAJ  +  AiQ  +  B(DiFQ  -1-  D^G)  +  ( DiFQ  +  DTG)tBt  +  r0Ad{P1  +  P2)A%  +  2 r0Q  <0 

[  Q  [AQ  +  B(D,FQ  +  D~G)}t 

\_AQ  +  B(DiFQ  +  D~  G)  Pi 

Q  QAV 

AdQ  P2 


<0 

(27) 

>o 

(28) 

>0 

(29) 
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Fig.  1 .  Estimation  of  domain  of  attraction  of  Example  1 . 


Fig.  2.  Estimate  of  domain  of  attraction  of  Example  2. 


TABLE  I 

Computation  Results  of  Example  1  by  Lyapunov-Krasovskii  Approach 


JS 

T 

a 

e 

P 

1 

0.01 

94.7215 

2.3225 

0.8703 

0.2046 

0.2046 

0.8980 

x  10"4 

1 

0.1 

86.5436 

2.1114 

0.8895 

0.1949 

0.1949 

0.9240 

x  10'4 

1 

1 

54.8073 

1.7449 

0.0835 

0.0166 

0.0166 

0.1139 

x  10-3 

T 

10 

no  solution 

0 

0.01 

97.6418 

4.1145 

0.7231 

0.3103 

0.3103 

0.6684 

x  i<r4 

0 

0.1 

86.5569 

2.3225 

0.8567 

0.2143 

0.2143 

0.8801 

x  10~* 

0 

1 

59.8417 

0.9850 

0.1305 

0.0060 

0.0060 

0.1371 

x  10~3 

0 

10 

27.8434 

0.4177 

0.1823 

0.0155 

0.0155 

0.2456 

x  10-3 

TABLE  II 

Computation  Results  of  Example  2 


TO 

a 

p 

F 

0.1 

1.5685 

0.2418  “0.0097 
-0.0097  0.0530 

[  -1.6523  0.8092  ] 

0.2 

1.2597 

0.3631  -0.0260 
-0.0260  0.0431 

[  -2.0026  0.8110  ] 

0.3 

1.2557 

0.5067  -0.0373 
-0.0373  0.0311 

[  -2.3284  0.7827  ] 

0.35 

0.9680 

0.9033  -0.0393  ' 
-0.0393  0.0256 

[  -2.6383  0.7204  ] 

dashed  curves  are  the  state  trajectories  with  the  initial  conditions  on 
this  ellipsoid  and  r  =  10.  Obviously,  all  trajectories  converge  to  the 
origin. 

If  we  use  the  LMI  optimization  (19)  by  Lyapunov-Krasovskii  ap¬ 
proach  with  the  above  control  law,  the  computational  results  are  shown 
i  Table  I.  From  this  table,  we  find  that  our  result  is  less  conservative 
than  that  of  [22]  because  our  estimate  of  domain  of  attraction  when 
r  =  1  and  /?  =  1  includes  the  ball  5(6)  with  8  =  a2  =  3.004  x  103 
which  is  much  bigger  than  the  ball  given  in  [22].  We  can  also  find  that 
the  estimation  of  the  domain  of  attraction  by  Lyapunov-Krasovskii  ap¬ 
proach  becomes  smaller  as  the  size  of  time-delay  becomes  larger. 


Example  2:  Consider  the  following  delay  system  (1 )  with 

0.5  -1  ' 

0.5  —0.5 

0.6  0.4  ‘ 

0  -0.5, 

11  - 
^  >  Umax  —  b* 

For  simplicity,  we  also  use  the  unit  ball  as  our  reference  set  We  are 
not  able  to  obtain  a  feasible  solution  to  LMI  optimization  problem  (13). 
This  means  that  this  system  may  not  be  delay-independently  stabiliz- 
able  by  a  saturated  memoryless  state  feedback  law.  Fortunately,  the  op¬ 
timization  problem  (30)  is  feasible  for  to  <  0.35.  This  means  that  this 
saturated  system  is  delay-dependently  stabilizable  with  a  memoiyless 
state  feedback.  Table  II  shows  the  computational  results  with  different 
time-delay.  From  Table  II,  we  find  that  a  increases  when  the  system 
time-delay  r0  decreases.  Fig.  2  illustrates  the  estimate  of  the  domain 
of  attraction  and  the  state  trajectories  for  r  =  0.35.  The  outer  ellip¬ 
soid  is  H(P,  1)  and  the  inner  ellipsoid  is  the  ball  5(a) .  The  dot-dashed 
curves  are  the  state  trajectories  with  initial  conditions  inside  this  ellip¬ 
soid  H(P,1). 


A  = 
Ad  = 
B  = 


VI.  Conclusions 

In  this  paper,  the  domain  of  attraction  of  time-delay  system  subject 
to  input  saturation  is  addressed  by  applying  Lyapunov-Razumihkin  and 
-Krasovskii  functional  approach.  An  estimation  of  the  domain  of  attrac¬ 
tion  is  proposed  by  using  the  linear  matrix  inequality  optimization.  We 
also  proposed  a  memoryless  state  feedback  design  method  for  the  sys¬ 
tems  with  time-delay  in  state  and  subject  to  input  saturation  to  enlarge 
the  domain  of  attraction.  Both  the  delay-independent  and  delay-depen- 
dent  local  stabilizing  controllers  are  discussed.  Numerical  examples 
show  the  effectiveness  of  the  proposed  method. 
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Multiple  Resonance  Networks 

Antonio  Carlos  M.  de  Queiroz 

Abstract— This  brief  shows  how  “multiple  resonance  networks”  of  any 
order  and  with  many  possible  structures  can  be  systematically  designed 
using  standard  lossless  impedance  synthesis  techniques.  These  networks 
are  composed  of  linear  lumped  or  distributed  capacitors,  inductors,  and 
transformers,  with  a  switch  separating  one  of  the  capacitors  from  the  re¬ 
maining  circuit.  They  have  the  property  of  transferring  completely  the  en¬ 
ergy  initially  stored  in  the  capacitor  insulated  by  the  switch,  to  another, 
much  smaller,  capacitor  in  the  circuit,  through  a  linear  transient  when  the 
switch  is  closed.  These  circuits  find  applications  in  the  production  of  very 
high  voltages  for  pulsed  power  systems. 

Index  Terms — Linear  network  synthesis,  power  converters,  resonance. 

I.  INTRODUCTION 

“Multiple  resonance  networks”  [1]  is  a  name  that  generalizes  the 
“double  resonance”  [2],  [3],  “triple  resonance”  [4]— [6],  and  the  higher 
order  networks  discussed  in  this  brief.  These  circuits  are  usually  com¬ 
posed  of  a  transformer  and  some  extra  capacitors  and  inductors  and 
work  by  transferring  the  energy  initially  stored  in  a  capacitor  at  one 
side  of  the  transformer  to  another,  much  smaller,  capacitor  at  the  other 
side  of  the  transformer,  through  a  linear  transient  composed  (in  the  ideal 
lossless  case)  of  a  sum  of  several  cosinusoidal  waveforms  (Fig.  1). 

The  “double  resonance”  case  is  long  known  [2],  [7]  as  the  “Tesla 
coil”  [3],  In  this  case,  only  two  capacitors  and  one  transformer  are  used, 
resulting  in  a  fourth-order  system  with  a  transient  formed  by  two  oscil¬ 
latory  modes  (Fig.  2).  With  the  system  properly  designed,  after  some 
cycles  all  the  initial  energy  in  C\  is  transferred  to  C2,  and  the  obtained 
voltage  is  given,  by  energy  conservation,  by 


(with  p  =  2).  This  same  equation  fixes  the  maximum  output  voltage 
for  all  the  systems  of  this  type. 

More  recently,  triple  resonance  systems  were  developed  [4]-[6]  for 
instrumentation  used  in  high-energy  physics.  An  additional  capacitor 
and  an  inductor  were  added  to  the  output  side  (Fig.  3),  with  the  aim 
of  reducing  the  voltage  stress  over  the  transformer  and  of  taking  into 
consideration  the  output  capacitance  of  the  transformer.  With  only  the 
extra  inductor  added,  the  system  is  still  a  double  resonance  system,  long 
known  as  the  “Tesla  magnifier.”  With  the  extra  capacitor  the  system  is 
of  sixth  order  and  the  transient  has  three  oscillatory  modes,  but  opera¬ 
tion  with  complete  energy  transfer  is  equally  possible. 

In  all  the  cases  found  in  the  literature,  the  design  of  these  systems  is 
based  on  the  analysis  of  a  fixed  structure.  The  following  sections  show 
that  the  design  can  be  made  by  synthesis,  can  be  applied  to  a  wide  range 
of  structures,  and  can  be  extended  to  systems  of  any  order. 

II.  Synthesis  Approach 

The  transformer  can  be  left  out  of  the  problem,  because  it  can  be 
inserted  after  the  synthesis  of  a  “ladder”  structure  composed  of  series 
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Abstract 

In  this  paper,  a  set  invariance  analysis  and  gain  scheduling  control  design  approach  is  proposed  for  the  polytopic  linear 
parameter-varying  systems  subject  to  actuator  saturation.  A  set  invariance  condition  is  first  established.  By  utilizing  this  set 
invariance  condition,  the  design  of  a  time-invariant  state  feedback  law  is  formulated  and  solved  as  an  optimization  problem 
■with  LMI  constraints.  A  gain-scheduling  controller  is  then  designed  to  further  improve  the  closed-loop  performance. 
Numerical  examples  are  presented  to  demonstrate  the  effectiveness  of  the  proposed  analysis  and  design  method.  ©  2002 
Elsevier  Science  B.V.  All  rights  reserved. 

Keywords:  Set  invariance;  Linear  parameter-varying  systems;  Gain-scheduling;  Actuator  saturation;  Linear  matrix  inequality 


1.  Introduction 

In  recent  years  there  has  been  significant  interest  in  the  study  of  linear  parameter-varying  (LPV)  systems, 
which  is  motivated  by  the  gain  scheduling  control  design  methodology  [9-11].  LPV  systems  are  systems 
that  depend  on  unknown  but  measurable  time-varying  parameters.  The  measurement  of  these  parameters 
provides  real-time  information  on  the  variations  of  the  plant’s  characteristics.  Hence,  it  is  desirable  to  design 
controllers  that  are  scheduled  based  on  this  information.  LPV  control  theory  has  proven  to  be  useful  to 
simplify  the  interpolation  and  realization  problems  associated  with  the  conventional  gain-scheduling.  The 
analysis  and  synthesis  of  LPV  systems  have  been  investigated  recently  in  [1,8,13,14]  by  the  linear  matrix 
inequality  approach.  The  approach  involves  the  design  of  several  linear  time-invariant  (LTI)  controllers  for  a 
parameterized  family  of  linear  time-invariant  system  models  and  the  interpolation  of  these  controller  gains. 

In  control  system  design,  actuator  saturation  is  inevitable.  It  can  severely  degrade  the  closed-loop  sys¬ 
tem  performance  and  sometimes  even  make  the  otherwise  stable  closed-loop  system  unstable  by  some  large 
perturbation.  The  analysis  and  synthesis  of  control  systems  with  actuator  saturation  nonlinearities  have  been 
receiving  increasing  attention  recently  (see,  for  example,  [2,5,7]  and  the  references  therein).  Very  often,  ac¬ 
tuator  saturation  is  dealt  with  by  either  designing  low  gain  control  laws  that,  for  a  given  bound  on  the  initial 
conditions,  avoid  the  saturation  limits,  or  estimating  the  region  of  attraction  in  the  presence  of  actuator  satura¬ 
tion.  In  this  paper,  we  will  analyze  the  stability  of  LPV  systems  with  actuator  saturation.  The  recent  analysis 
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approach  proposed  in  [5,6]  is  used  to  analyze  the  set  invariance  and  then  a  gain-scheduled  optimal  control 
design  is  proposed.  The  resulting  closed-loop  system  not  only  possesses  a  large  domain  of  attraction  that 
contains  a  priori  given  set  of  initial  conditions,  but  also  guarantees  a  minimal  performance  index. 

The  paper  is  organized  as  follows.  Problem  statement  and  the  preliminaries  will  be  given  in  Section 
2.  Set  invariance  of  LPV  systems  subject  to  actuator  saturation  will  be  analyzed  in  Section  3.  A  linear 
time-invariant  controller  design  method  based  on  the  LMI  optimization  will  also  be  introduced  in  this  section. 
A  gain-scheduled  controller  design  method  will  be  proposed  in  Section  4.  In  Section  5,  numerical  examples 
will  be  used  to  illustrate  the  proposed  analysis  and  design  method.  The  paper  will  be  concluded  in  Section  6. 


2.  Problem  statement  and  preliminary 

2.1.  Problem  statement 

We  consider  the  polytopic  LPV  systems,  whose  system  matrices  are  affine  functions  of  a  parameter  vector 
p(t),  subject  to  actuator  saturation, 

x{t)  =  A(p(t))x(t)  +  B(p(t))c(u(t)),  (1) 

z(t)  =  C(p(t))x(t)  +  D(p(t))a(u(t)),  (2) 


where 


=  Pj(t)Aj, 
y=i 


=  V"  Pj(t)Bj, 
y=i 


c(p(t))=^rPj(t)Cj, 

j= i 


r 

t))  =  Y'  PjiODj 

;=i 


with  x  e  (R"  denoting  the  state  vector,  ueUm  the  control  input  vector,  zeUp  the  control  output  vector  and 
p{t)=[pi(t)  p2(t)  ...  pr(t)]T  €  IRr  the  time-varying  parameter  vector.  It  is  assumed  that  the  time-varying 
parameter  vector  pit)  belongs  to  the  unit  simplex  where 


,J 


V  pj  -  1,  0  pj  ^ 

u=> 


,1. 


(3) 


Therefore,  when  p,(t)  =  1  and  Pj{t)  =  0  for  je[l,r],j^i,  the  LPV  model  (1)— (2)  reduces  to  its  fth  linear 
time-invariant  “local”  model,  i.e.,  {A(p),B{p),  C(p),D(p))=(AuBiy  C,,A).  That  is,  the  LPV  system  matrices 
vary  inside  a  corresponding  polytope  Q  whose  vertices  consist  of  r  local  system  matrices 


Q  =  co{(Aj,Bj,  Ci,Dj\  i  €  [l,r]}, 


(4) 


where  co  denotes  the  convex  hull. 

The  function  c  :  IRm  — »  Km  is  the  standard  saturation  function  of  appropriate  dimensions  defined  as  follows 


o(u)  -  o(u2)  ■  •  •  o(um )]T, 

where  o-(m,)  =  sign(«/)min{l,  |w,j}.  Here  we  have  slightly  abused  the  notation  by  using  o  to  denote  both 
the  scalar  valued  and  the  vector  valued  saturation  functions.  Also  note  that  it  is  without  loss  of  generality 
to  assume  unity  saturation  level.  The  non-unity  saturation  level  can  be  absorbed  into  the  input  matrices  by 
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applying  the  following  substitution 

B  =  BU,  D  =  DU,  u  =  U~1u, 

where  U  =  diag(wmaX; ,),  and  wmax,,-  is  the  saturation  amplitude  of  the  ith  input. 

The  aim  of  this  paper  is  to  study  the  design  of  a  linear  state  feedback  law 

u(t)  =  Fx(t)  (5) 

or  a  time-vaiying  parameter-dependent  linear  state  feedback  law 

r 

u(t)  =  T  Pi(t)FiX(t),  (6) 

i=i 

which  asymptotically  stabilizes  the  LPV  system  subject  to  actuator  saturation  (1).  Control  law  (5)  is  a  constant 
feedback  law,  while  (6)  is  a  time-varying  feedback  law.  Control  law  (6)  is  the  so-called  gain-scheduled 
controller. 

In  this  paper,  we  will  consider  the  optimal  control  problem  of  the  LPV  plants  subject  to  actuator  saturation. 
That  is,  we  will  design  a  control  u,  which  minimizes  the  following  worst-case  performance  subject  to  the 
LPV  model  (l)-(2): 

min  max  ^ J  —  ^  zT{t)z( r)^  .  (7) 

u(t)  (.A(.p),B(p),C(p),D(p))eQ  0 

2.2.  Some  mathematical  tools 

Let  ft  be  the  ith  row  of  the  matrix  F.  We  define  the  symmetric  polyhedron 
S?(F)  =  {x£  R":  \fiX\  <  1,  i  =  1, 2, . . ,,m}- 

If  the  control  u  does  not  saturate  for  all  i  - 1,2,.  ..,m,  that  is  xe££{F),  then  nonlinear  system  (1)  admits 
the  following  linear  representation 

x(t)  =  (Ap(t))  +  B(p(t))F)x(t).  (8) 

Let  P  e  R"x"  be  a  positive-definite  matrix.  For  a  positive  number  p,  denote 
Q(P,  p)  =  {x£Un:  xTPx  <  p}. 

An  ellipsoid  Q(P,p)  is  inside  i?(F)  if  and  only  if 

fiiP/p)-'/!  1,  i  =  1,2, 

Let  "f  be  the  set  of  m  x  m  diagonal  matrices  whose  diagonal  elements  are  either  1  or  0.  For  example,  if 
m  =  2,  then 

rro  oi  [o  oi  ri  oi  n  on 

T  ~  OO’Ol’OO’Ol 

There  are  2m  elements  in  Y .  Suppose  that  each  element  of  Y  is  labeled  as  Et,  i  =  l,2,...,2m,  and  denote 
E~  —  I  -  Ej.  Clearly,  E~  is  also  an  element  of  Y  if  £,  e  Y. 

Lemma  1  (Hu  and  Lin  [5]).  Let  F,H  €  Rmx"  be  given.  For  x  6  R",  if  xG  then 

o{Fx)  G  co {EiFx  +E~Hx:  i  G  [l,2m]}, 
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This  means  that  we  can  rewrite  o(Fx)  as 


2m 


o(Fx)  =  Tru{E,F  +  E-H)x, 


i=l 


where  0  ^  77,-  <  1,  Yn=i  ft  =  1- 

Lemma  2.  Suppose  that  matrices  M,  G  IRmx'’,  1  =  1,2,...,?-,  and  a  positive  semi-definite  matrix  P  G  RmXm  are 
given.  If  Yfi=i  P‘  =  1  aM^  0  Pi  L  then 


(  r  \T  /  r  \  r 

p,M/  P  Y'  p/Mf  <  V  piM] PM i. 


(9) 


i=i 


i=i 


<=i 


Proof. 


r  r 


^Y'  P  ^Y'  piM^  =  Y  p)M] PM i  +  YY  piPj(M?PMj  +  MjPMi) 


1=1 


1=1 


1=1 


1=1  y<i 
r  r 


<  V  +  W  Pi Pj(MjPMi  +  MjPMj ) 

i=i  i=i  y« 


=  Y'  piMjPMi.  □ 

i=i 


3.  A  set  invariance  condition 

For  a  given  LPV  system  subject  to  actuator  saturation  and  a  given  linear  control  law  u—Fx,  we  first  need 
to  establish  a  set  invariance  condition.  For  simplicity,  we  will  denote 

AiJ  =  Ai  +  Bi(EjF  +  EJH), 

Cij  =  C-,  +  Di(EjF  +  EJ. H). 


Theorem  3.  For  a  given  system  (1)  and  a  given  state  feedback  control  matrix  F,  the  ellipsoid  Q(P,y)  is  an 
invariant  set  of  the  closed-loop  system  under  linear  state  feedback  control  law  (5)  if  there  exists  a  matrix 
HeUmXn  satisfying  the  following  matrix  inequalities 

(A,  +  BfiEjF  +  E~H))rP  +  P(Aj  +  BfEjF  +  EJ  H)) 

+  (C,-  +  Di(EjF  +  EJH))T(Ci  +  DfEjF  +  EJH))  <0,  i €  [1, r],  j G  [l,2m]  (10) 

and  Q(P,y)  C  £C(H).  Moreover,  for  any  initial  condition  x0eQ(P,y),  the  performance  objective  function 
(7)  satisfies 

J  <  x^Pxq  =$  y. 
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Proof.  Choose  a  Lyapunov  function 
V(x )  =  xTPx. 

Then, 

V  =  [A(p)x  +  B(p)a(Fx)]rPx  +  xJP[A(p)x  +  B(p)a(Fx)]. 

By  Lemma  1,  we  have 

r  -  r  1T 

V=xr  ,T  PiAi  +  T  PiirV  tjj(EjF  +  EJH) ,  Px 

1  i=  1  i=l  7=1 

r  r  r  2"  1 

+xTP  |  V'  PiAi  +  V'  piBi V'  t\j(EjF  +  Ej  H)  |  x 

1  i= 1  i=l  y-l 

r  2" 

=  W  p,^xT[(^f  +  Bi(EjF  +  P/P))TP  +  P(^i  +  Bi(EjF  +  2?;//))]x. 

i=i  ]—\ 

On  the  other  hand,  (10)  implies  that  the  following  matrix  inequalities  hold: 

(Ai  +  Bi(EjF  +  EJH))rP  +  P(At  +  B^EjF  +  EJH))  <0  Vi  €  [l,r],  j  e  [1,2*1 
which  implies 

V<0  Vx G Q(P, y)\ {0}. 

Thus,  if  xJPx o  <  y,  then  xr(t)Px(t)  ^  y  for  r  >  0,  i.e.,  G(P,y)  is  a  positively  invariant  set.  This  also  implies 
that  system  (1)  is  asymptotically  stable  at  the  origin  with  Q{P,y)  contained  in  the  domain  of  attraction. 

To  complete  the  proof,  we  note  that 

f°°  f°°  - 

J  =  1  (zTz  +  F(x))dr+xJPx0  =  1  J(t)dt +xJPxo, 

0  o 

where 

J(t)  =  zr(t)z(t)  +  V(x)- 

By  Lemma  1,  we  can  rewrite  (2)  as 

r  r 

z(i)  =  V'  piCix(t)  +  Y'  PiDio{Fx{t)) 

1=1  1=1 

r  f  2m  \ 

=  V  Pi  i  Qx(t)  +  Di  V  4-  £“ #  MO  | 

i=l  7~1 

r  2m 

i=l  y=l 
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Hence,  by  Lemma  2, 

J(t)=Z\t)z{t)+V(x) 

r  2"  (  r  2™  \T  /  r  2"  \ 

=  W  pfljjXt(AlJP  +  PAij)x  +  I  W  PiVjCijx  I  i  w  PiTjjCijx  I 
/-I  j= i  '  i=  i  j-i  '  '  1=1  y=i  1 


2m 


<  V'Y'  pirijXT(AiijP +  PAjj)x  +  V'Y'  p,rijx1CijCijx 
/=  1  7=1  1=1  7=1 

=  VY'  pir\JxT(AijP  +  M,;  +  clfijy. 

<=1  7=1 

It  is  easy  to  see  that  if  matrix  inequalities  (10)  hold,  i.e., 
then  J(t)  ^  0,  which  implies  J  ^  XqPxo  <  y.  □ 

Remark  L  If  we  do  not  consider  the  optimal  performance  index  (7),  Theorem  3  is  a  set  invariance  condition 
of  LPV  system  subject  to  actuator  saturation.  For  the  special  case  of  r  =  1,  Theorem  3  recovers  the  set 
invariance  condition  for  linear  time-invariant  systems  subject  to  actuator  saturation  [5].  Additionally,  Theorem 
3  also  addressed  the  quadratic  performance  problem  for  linear  systems  subject  to  actuator  saturation. 

Based  on  Theorem  3,  we  can  present  the  following  optimization  problem  minimizing  the  upper  bound  of 
the  performance  function  (7)  for  a  given  initial  condition  set  2C§: 


mm 

P>0,F,H 

S.t. 


(a)  9Cq  c  Q(P,y), 

(b)  inequalities  (10)  VzG[l,r],  j€[ 1,2W], 

(c)  \hjx\  <  1  V*e£2(P,y),  i  =  [l,m], 


(11) 


where  hi  denotes  the  ith  row  of  K 

The  feasibility  of  the  above  optimization  problem  (11)  ensures  the  existence  of  a  stabilizing  state  feedback 
matrix  F  such  that  the  given  initial  condition  set  5T0  is  contained  in  the  domain  of  attraction  of  the  system 
(1  )_(2),  and  the  performance  index  J  ^  y.  On  the  other  hand,  for  a  given  constant  control  matrix  F  designed 
for  the  systems  without  considering  actuator  saturation,  (11)  can  also  be  used  to  determine  if  an  initial 
condition  set  9C§  is  contained  in  the  domain  attraction  of  the  origin  when  the  system  is  subject  to  actuator 
saturation.  In  what  follows,  we  will  show  that  the  optimization  problem  (11)  can  be  solved  as  an  LMI 
optimization  problem. 

For  simplicity,  we  assume  that  the  initial  condition  set  2£$  is  the  combination  of  some  given  points, 

where  *{,  G  R",  i  =  1,2, . . . ,  I,  are  some  given  points.  Let 

Q  =  (P/y)-\  Y  =  FQ,  Z=HQ. 
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(12) 


Then,  Condition  (a)  is  equivalent  to 

(x‘)TPx‘  ^  y  «/!>*  1  =  1,2,...,/. 

■*0 

Condition  (b)  is  equivalent  to 

F  (AiQ  +  BiiEjY  +  Ej-Z))t  +  (AiQ  +  BfEjY  +  EJ  Z»  *  1  <f) 

QQ  +  DiiEjY  +  EJZ)  -yl 

for  Vi  €  [l,r],  V/'  €  [l,2m].  Condition  (c)  is  equivalent  to 

'  l  *,2' 

2*7  2  . 

Also  let  die  zth  row  of  Z  be  z,-,  i.e.,  z(-  =  hjQ.  The  optimization  problem  (11)  can  then  be  reduced  to  the 
following  one  with  LMI  constraints, 

(4f 


L  ?  '  J  — 


1 


>0  Vi  €[!,«]. 


min  y,s.t  (a) 
2>o.y,z 


'  1 
A 


>o  Vie [1,11 


X'o  Q 

(b)  LMI  (12)  V/6[l,r],  ye  [1,2"], 


(c) 


1 


Zi 


$s0  Vi€[l,m]. 


(13) 


Theorem  4.  For  a  given  system  (1),  the  state  feedback  control  matrix  F  that  minimizes  the  upper  bound 
of  performance  function  (7)  can  be  solved  by 

F=YQ~l, 

where  ( Q  >  0,  Y)  is  the  solution  of  the  LMI  optimization  problem  (13). 


In  the  optimization  problem  (13),  the  amplitude  of  control  law  (5)  is  not  constrained,  i.e.,  there  is  no 
control  amplitude  constraint  on  the  control  law.  In  [6],  the  authors  proved  that  this  controller  design  method 
is  less  conservative  than  the  approaches  based  on  circle  criterion  and  Popov  criterion  [4].  On  the  other  hand, 
to  avoid  the  controller  gain  being  too  large,  we  may  constrain  it  to  be  bounded  by  po  >  1,  i.e.,  |/,x|  po, 


which  is  equivalent  to  the  following  LMI 
>0  Vi€[l,i»], 


Mo 

lyJ 


Yi 

2 


where  y{-  denotes  ith  row  of  Y. 

If  we  require  Y  =  Z,  then  we  recover  the  design  algorithm  which  constrains  the  optimal  control  law  to  be 
unsaturated  [3].  The  unsaturated  control  algorithm  can  be  described  as 


mm  y9 
q>o,y 


“  Wli  (2 


s  VT 1 


Vie  [i,i]. 


(b) 

(C) 


(AiQ  +  BiYf  +  (A,Q  +  BiY) 
QQ  +  DJ 


-yl 


<0  Vi€[l,r], 


i  yt 

yj  2 


^0  Vi€[l,m]. 


(14) 
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Note  that  the  constraints  in  (14)  imply  that  1)  C  3?(F)  and  hence  the  control  u  —  Fx  will  never  reach 

saturation  limits.  In  (13),  we  permit  the  control  to  be  saturated  and  hence  our  algorithm  will  result  in  a  larger 
domain  of  attraction.  It  is  known  that  low-gain  controllers  that  avoid  saturation  will  often  result  in  low  levels 
of  performance,  especially  for  the  cases  where  the  disturbance  is  intermediate  or  small  amplitude. 


4.  Gain-scheduled  control  law  design 


The  approach  to  gain-scheduling  involves  the  design  of  several  LTI  controllers  for  a  parameterized  family 
of  time-invariant  system  models  and  the  interpolation  of  these  controller  gains.  If  the  time-vaiying  parameter 
vector  p(t)  can  be  measured  or  estimated  on-line,  then  we  can  design  a  gain-scheduled  control  law 
(r  \ 

u(t):=F(t)x(t)=  |  V  pj{t)Fj  j  x(t),  (15) 


;=i 


where  Fj  is  the  “local”  state  feedback  matrix  for  the  local  model  ( Aj,Bj ).  It  is  reasonable  to  expect  that  this 
kind  of  control  laws  can  result  in  a  larger  domain  of  attraction  and  better  performance.  Note  that  F  in  (5)  is 
a  constant  matrix,  while  F  in  (15)  is  a  time-varying  matrix  function  of  time- varying  parameter  p{t)  although 
matrices  F/s  are  constant  for  all  j  =  1, 2, . . . ,  r. 

With  control  law  (15),  the  closed-loop  system  (l)-(2)  can  be  rewritten  as 

r  r 

x(t)  =  V"  PiAjX(t)  +  V  piBi<j(Fx(t)), 

/=  l  /=i 


r  r 

z(t)  -  V'  PiCix(t)  +  S'  piDio{Fx(t)). 

i=l  (=1 

By  Lemma  1,  we  have  that  for  any  matrix  H  of  the  same  dimensions  of  F  such  that  x  e  SB (H), 

r  (■  2m  -j 

m  =  V  Pi  AiX( 0  +  Bt  V  ns{t)(EsF  +  E~H)x(t) 

1=1  5=1 


r  T 

=  y  PiT  n,[A,  +  Bi(EsF  +  et&MO 

i-l  5=1 

and 

im  r 

z(0  =  y^y  Pi[Ci  +  Di(EsF  +  E-HMt), 

5=1  1=1 

where  0  ^  rjs(t)  <  1,  »fr(0  =  U  for  aI1  5=  1,2,..., 2*.  If  we  let 

r 

H  =  V  pjHh 


x(t) = y  ut)T  p,y  pjASiiJx(t), 

5=1  1=1  j—  1 

2m  r  r 

r(0  =  V  pi  V  PjCs, 

5=1  i=l  j—  1 


(16) 


(17) 
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where 

As,  +  Bi(EsFj  +  E~ Hj\ 

CSt ij-Q  +  Di(EsFj  +  E~Hjl  s£[  1,2"],  zje[l,r]. 


Remark  2.  It  is  easy  to  find  that  the  closed-loop  system  described  by  (16)— (17)  can  be  further  simplified  if 
the  subsystems  possess  common  input  matrices  B  and  A  namely  Bi  =  B,  Di  =  D  for  all  L  In 

this  case,  the  closed-loop  system  (l)-(2)  can  be  simplified  as  , 

2M  r 

m  =  v  Ut)  V  Pi(Ai  +  B{EsFt  +  E~  Hj))x(t), 

s=\  i-1 

2"  r 

z(t)  =  V  fa(0  V  Pi{Ci  +  D{ESF-,  +  E~Hi))x(t). 

5=1  1=1 


Theorems.  Suppose  that  system  (l)-(2)  anJ  r/zc  /oca/  state  feedback  control  matrices  Fjy  j  =  1,2, 
arc  given .  77zc  ellipsoid  Q(P,  y)  is  an  invariant  set  of  the  closed-loop  system  under  the  gain- scheduled  state 
feedback  law  (15)  if  there  exist  matrices  Hj  €  Umxn)  j  =  1, 2, . . . ,  r,  satisfying 

{A,  +  Bj(EsFj  +  ETHjyfP  +  P(A ,  +  BfiE.Fj  +  EfHj)) 

+(C,+A(£/;  +  EfHj))T(Ci  +  Di(EsFJ  +  EfHJ))  <  0,  i,je[l,r],  j€[1,2"1  (18) 

and  £2(P,y)  C  f);=i  SP(Hi).  Moreover,  for  any  x()  £  Q(P,y),  the  performance  objective  function  (7)  satisfies 
J  <  x^Px o  y. 


Proof.  Choose  a  Lyapunov  function  V(x(t))  =  xT(t)Px(t).  We  note  that 

r 

x^n^Hj), 

7=1 

implies 

/ '  N 

x  G  SF  .  >  pjHj  j  , 

'  J=l 

since  ]T^=1  Pj  =  ^  and  0  ^  Pj  ^  1*  Let 

r 

8-Y'pjHj. 

y=i 

Then,  by  Lemma  1, 

f  f  r  2"  1 T  C  r  2"  ]  ) 

F  =  xT(0  i  V  V  t]s(Aj  +  BfiEsF  +  EJH))  P  +  P  V  J/M'  +  Bi(EsF  +  ^))  V  x(r) 

^  i=l  5=1  t=l  ^=1  J 


=  XT(0 


f  r  2-  r  r  .1T  T  2”  r  r  _  1  ] 

|  5  Y]s  ^  5  Pi  PjAs,  i,  j  |  P  “f“  P  j  )  T]s  N  \  Pi  PjAs,  i,  j  \  2c(t). 


I 


f=l  7=1 


5=1  1=1  7=1 


J 


5= 


(19) 
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It  is  easy  to  see  that  (18)  implies 

ijP  +  t> j<0>  hjG[l9r],  ^€[l,2m]. 

Hence,  we  have  V(x)  <  0  for  all  x€Q(P,y)\{ 0}.  That  is,  the  system  is  asymptotically  stable  at  the  origin 
with  £2(P,y)  contained  in  the  domain  of  attraction. 

Similar  to  the  proof  of  Theorem  3,  we  can  prove  that 

J(t)  =  zT(t)z(t)+V(x(t))^0 

if  matrix  inequalities  (18)  holds  and  hence  J  <  XqPx0  <  y.  □ 

Corollary  6.  For  the  special  case  of  Bi  -B  and  Dj=D  for  all  i,  the  ellipsoid  Q(P,y)  is  an  invariant  set  of 
the  closed-loop  system  under  the  gain-scheduled  state  feedback  control  law  (15),  if  there  exist  r  matrices 
Hi  e  Umxn,  satisfying 

(Ai  +  B(EsFi  +  E-Hi))rP  +  P(Ai  +  B(ESF,  +  EfH{j) 

+  (Ci  +  D(EsFi+EfHi))T(Ci+D(EsFi  +  EfHi))<0,  i€[l,r],  se[  1,2"],  (20) 

and  Q(P,  y)  C  n,r=i  &(Hi).  Moreover,  for  any  xQ  G  0(P,y),  the  performance  objective  function  (7)  satisfies 
J  <  XqPxo  <  y. 


In  what  follows,  we  present  a  less  conservative  set  invariance  condition. 
Note  that  system  (16)— (17)  can  be  rewritten  as 


{  ±rH."+±±ip,pj 

s=\  l  1=1  i—  1  j<i  \  /  J 

2m  f  r  r  r 

z(o=E^iE  u+YY  2P‘ 

s= 1  l  1=1  1=1  j<i 


cs,  i  j  j-  CSi  y  i 


Let 


f0ri<J'= U . "■ 


We  then  have 

r(r+l)/2 

0  <  A  <  1,  Pl~^ 

7=1 

and 

2m  r(r+l)/2 

x=y^  Y 

i=i  /= i 

2"  r(r+ 1)/2 

z=Yn5  Y  pfi*dx- 
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Hence, 


I"  2"  r(r+l)/2  _  "| 

V(x)—xT  Y'rts  V  p,(AJS'  ,P  +  PASy  i)  x, 

5=1  7=1 


r  2"  r(r+l)/2  1  /  2m  r{r+ 1)/2  \T  /  2m  r(r+l)/2  \ 

J(0  =  *T  >  IJ.  V  +  *  +  *T  V %  V  pA ,  V tit  y'  pA,i  x- 

j=1  7=1  5“!  7—1  S—  1  7=1 


Theorem  7.  Suppose  that  system  (1)— (2)  and  the  local  state  feedback  control  matrices  Fjr  j— 1,2 are 
given.  The  ellipsoid  Q(P,y)  is  an  invariant  set  of  the  closed-loop  system  under  the  gain-scheduled  control 
law  (15),  if  there  exist  matrices  Hj€Umxn,  j  =  1,2,..., r,  satisfying 


a\  u  y  +  PAS,  /,  f  +  Cl A  /, ,  <  0,  i  €  (1,  r],  s  €  (1, 2m], 


(21) 


(As,  i,  j  +  AS:  j t  i  f  P  +  P(ASi  it  j  +  J is,  J,  i  ) 

+  l(Cs,U  +  C*,j.t)T(Cs,i,j  +  CsJ,i')<  0>  <<ye[l,r],  5€[1,2’B]  (22) 

and  Q(P,y)  C  f|[=i  -2%#;).  Moreover,  for  any  x0eC2(P,y),  the  performance  objective  function  (7)  satisfies 


J  s?  xJPxo  <  V- 

Remark  3.  In  comparison  with  Theorem  5,  the  number  of  matrix  inequalities  in  Theorem  7  is  reduced  by 
r(r  -  i)  x  2m~l.  In  comparison  with  Corollary  6,  another  r(r-  1)  x  2m_1  matrix  inequalities  can  be  removed 
for  the  special  case  of  2?,-  =  B  and  A  =  A  Vi. 


Let 


Q  =  (P/y)~\  Yj  =  FjQ,  Zj  =  HjQ,  je[l,r]. 

Denote  the  fth  row  of  the  matrix  Zj  as  zj.  Then  (21)  and  (22)  are  equivalent  to  the  following  LMIs 
f(AiQ  +  £i(EsYi  +  Es-Zi))r  +  (AiQ  +  Bi(EsYi  +  Es-Zi))  *  1 

<u,  i  e  [i,rj,  j  t  j 

CiQ  +  Di(EsYj  4-  Es  Zj)  —yl  _ 


(23) 


and 


AjQ  +  Bj(EJj  +  EfZj)  +  AjQ  +  BfiEJj  +  EfiZj) 

+(AjQ  +  Bj(EsYj  +  EfZf  +  AjQ  +  Bj(EsY,  +  EjZfjf 


* 


<0,  i</e[l,r],  se[l,2"]. 


QQ  +  Dj(EsYj  +  EfZj)  +  CjQ  +  Dj(EsY,  +  EfZj)  -2  yl  J 


(24) 


respectively.  Then,  we  have  the  following  theorem. 

Theorem  8.  Suppose  that  system  (1)— (2)  and  local  state  feedback  control  matrices  Fh  j=  1,2,  ...,r,  are 
given.  Then  gain-scheduled  state  feedback  control  law  (15)  that  minimizes  the  upper  bound  of  performance 
function  (7)  can  be  solved  by 

Fj  =  YjQ V/  €  [1,  r ], 
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where  ( Q  >  0,  Yj)  is  a  solution  of  the  following  LMI  optimization  problem : 
min  y, 

Q>0,Yj,Zj 

s.t.  (a)  (fl,o  Vi  e  [1,  /], 

x0  is 

(b)  LMI  (23),  (24), 

(C)  ^  (4)t  2 1  ^  °  Vl  €  [1’ m]’  J  e  ll,r]'  (25) 


5.  Numerical  examples 


Example  1.  First,  we  consider  a  simple  LPV  system  with  the  following  system  matrices 


[0  1  1 

0.1  -0.1 


*  -  rai 


n 


B  i  =B2  = 


roi 


Cl 


_c  _ri 

—  c?  —  „ 


ol 

0  ’ 


A  —  D2  = 


fol 

1  ' 


The  system  output  is  y  —  x\ .  The  input  is  subject  to  saturation  wmax  =  1.  We  are  interested  in  designing  an 
optimal  controller  such  that  the  initial  condition  xq  ~  [4  —  1]T  is  contained  in  the  domain  of  attraction  of  the 
origin.  The  unsaturated  control  algorithm  (14),  the  constant  control  algorithm  (13)  and  the  gain-scheduling 
control  algorithm  (25)  are  used  to  design  the  control  law  respectively.  Table  1  shows  the  computation  results 
by  the  different  control  algorithms. 


Fig.  1  shows  the  outputs  and  inputs  of  the  system  by  the  different  controllers  with 
=  0.5  —  0.5  sin(0.l7rt  —  0.57i), 

p2  =  0.5  -h  0.5  sin(0.l7rt  —  0.57r). 

The  dotted  curves  correspond  to  the  controller  computed  by  algorithm  (14),  the  dotted  dash  curves  correspond 
to  algorithm  (13)  and  the  solid  curves  correspond  to  algorithm  (25).  It  is  obvious  that  the  gain-scheduled 
controller  has  the  shortest  rising  time  and  the  smallest  performance  cost  while  the  unsaturated  controller  has 
the  longest  rising  time  with  the  largest  cost. 

If  the  initial  condition  x0  —  1.3  x  [4  -  1]T,  we  find  the  unsaturated  control  algorithm  (14)  and  the  con¬ 
stant  control  algorithm  (13)  cannot  obtain  a  feasible  solution  while  the  gain-scheduling  control  algorithm 
(25)  can  still  work  well.  This  implies  that  the  gain-scheduled  controller  can  result  in  a  larger  domain  of 
attraction. 


Table  l 

Computation  results  by  different  algorithms 

Algorithm  (14)  Algorithm  (13)  Algorithm  (25) 

F  [  -  0.2703  -  1.6093]  •  [  -  2.4772  -  12.1 166] 

y  120.4165  120.3905 


Fi  ~  [  —  4.0303  —  15.4821] 
F2  =  [-  3.8787  -  15.7463] 

32.6565 
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Fig.  1.  The  outputs  and  inputs  of  Example  1  with  different  controllers  solved  by:  algorithm  (14)  (dotted  curves),  algorithm  (13)  (dotted 
dash  curves)  and  algorithm  (25)  (solid  curves). 
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Fig.  2.  Coupled  spring-mass  systems. 


Example  2.  The  second  example  is  about  the  control  of  a  two-mass-spring  system  shown  in  Fig.  2.  The 
system  is  given  by  the  following  state  space  equations  [12] 
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y  =  x 2. 

Here,  x\  and  x2  are  the  positions  of  the  two  carts  respectively,  and  x3  and  x4  are  their  respective  velocities.  m\ 
and  m2  are  the  masses  of  the  two  bodies  and  K  is  the  spring  constant.  For  the  nominal  system  mi  =m2=l  with 
appropriate  units.  The  spring  constant  is  assumed  to  be  uncertain  in  the  range  ^mjn  =  0.5  <  K  <  Km3x  =  2. 
It  is  assumed  that  exact  measurement  of  the  state  is  available.  In  the  simulation,  we  set  the  performance 
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Performance  bounds  computed  by  different  algorithms 


Algorithm  (14)  Algorithm  (13)  Algorithm  (25) 


t 


Fig.  3.  The  outputs  and  inputs  of  the  two-mass-spring  system  with  different  controllers  solved  by:  algorithm  (14)  (dotted  curves),  algorithm 
(13)  (dotted  dash  curves)  and  algorithm  (25)  (solid  curves). 
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and  we  assume  that  the  saturation  limit  is  «max  =  0.5  and  that  the  time-varying  parameter  is  given  as 


K  =  ^(0.5  +  0.5sin(0.0lTtf))  +  ^max(0.5  -  0.5  sin(O.Olm)). 

We  compare  the  simulation  results  by  the  different  control  algorithms:  unsaturated  control  algorithm  (14),  the 
constant  control  algorithm  (13)  and  the  gain-scheduling  control  algorithm  (25).  Table  2  shows  the  computed 
performance  bounds  y  by  using  the  different  algorithms.  Fig.  3  shows  the  computed  outputs  and  inputs,  where 
the  dotted  curves  are  obtained  by  using  the  unsaturated  control  algorithm  (14),  dotted  dash  curves  by  using 
the  constant  control  algorithm  (13)  and  the  solid  curves  by  the  gain-scheduling  control  algorithm  (25).  We  see 
that  the  controller  computed  by  the  unsaturated  control  algorithm  (14)  leads  to  the  largest  overshoot  and  the 
longest  rising  time  This  is  because  the  input  is  not  able  to  reach  the  saturation  limit  due  to  the  conservatism 
of  algorithm  (14).  On  the  other  hand,  it  is  observed  that  the  gain-scheduling  control  algorithm  can  result  in 
a  faster  response  than  the  constant  control  algorithm  (13).  From  the  simulation  results,  we  can  conclude  that 
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the  gain-scheduling  control  algorithm  (25)  improve  the  performance  with  both  output  and  input  reaching  the 
set-point  in  shorter  time. 


6.  Conclusions 

In  this  paper,  we  have  addressed  the  set  invariance  and  the  gain-scheduling  control  for  LPV  systems  subject 
to  actuator  saturation.  The  positively  invariant  set  of  LPV  systems  subject  to  actuator  saturation  is  analyzed  by 
vertex  system  analysis  approach.  The  optimal  control  problem  for  the  given  initial  condition,  i.e.,  steering  it  to 
the  origin  with  the  minimal  performance  cost,  is  solved  with  the  LMI  optimization  approach.  A  gain-scheduled 
controller  design  method  is  proposed  to  reduce  the  conservativeness.  The  numerical  examples  also  demonstrate 
the  effectiveness  of  our  design. 
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Chapter  3 

Null  Controllability  and  Stabilization 
of  Linear  Systems  Subject  to 
Asymmetric  Actuator  Saturation1 

T.  Hu,  A.  N.  Pitsillides,  and  Z.  Lin 
University  of  Virginia,  Charlottesville,  Virginia 


3.1.  Introduction 

We  consider  the  problem  of  controlling  exponentially  unstable  linear  sys¬ 
tems  subject  to  asymmetric  actuator  saturation.  This  control  problem 
involves  basic  issues  such  as  characterization  of  the  null  controllable  re¬ 
gion  by  bounded  controls  and  stabilizability  on  the  null  controllable  region. 
These  issues  have  been  focuses  of  study  of  and  are  now  well- addressed  for 
linear  systems  that  are  not  exponentially  unstable.  For  example,  it  is  well- 
known  [10,11]  that  such  systems  are  globally  null  controllable  with  bounded 
controls  as  long  as  they  are  controllable  in  the  usual  linear  system  sense. 

In  regard  to  stabilizability,  it  is  shown  in  [12]  that  a  linear  system  subject 
to  actuator  saturation  can  be  globally  asymptotically  stabilized  by  smooth 
feedback  if  and  only  if  the  system  is  asymptotically  null  controllable  with 
bounded  controls  (ANCBC),  which,  as  shown  in  [10,11],  is  equivalent  to 
the  system  being  stabilizable  in  the  usual  linear  sense  and  having  open  loop 


1  Work  supported  in  part  by  the  US  Office  of  Naval  Research  Young  Investi¬ 
gator  Program  under  grant  N 00014-99- 1-0670. 
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poles-  in  the  closed  left-half  plane.  A  nested  feedback  design  technique  for 
designing  nonlinear  globally  asymptotically  stabilizing  feedback  laws  was 
proposed  in  [14]  for  a  chain  of  integrators  and  was  fully  generalized  in  [13]. 

The  notion  of  semiglobal  asymptotic  stabilization  on  the  null  control¬ 
lable  region  for  linear  systems  subject  to  actuator  saturation  was  introduced 
in  [7].  The  semiglobal  framework  for  stabilization  requires  feedback  laws 
that  yield  a  closed-loop  system  which  has  an  asymptotically  stable  equi¬ 
librium  whose  domain  of  attraction  includes  an  a  priori  given  (arbitrarily 
large)  bounded  subset  of  the  null  controllable  region.  In  [7],  it  was  shown 
that,  for  linear  ANCBC  systems  subject  to  actuator  saturation,  one  can 
achieve  semiglobal  asymptotic  stabilization  on  the  null  controllable  region 
using  linear  feedback  laws. 

On  the  other  hand,  the  counterparts  of  the  above  mentioned  results  for 
exponentially  unstable  linear  systems  are  less  understood.  Recently,  we 
made  an  attempt  to  systematically  study  issues  related  to  null  controllable 
regions  and  the  stabilizability  on  them  of  exponentially  unstable  linear  sys¬ 
tems  subject  to  actuator  saturation  and  gave  a  rather  clear  understanding 
of  these  issues  [4].  Specifically,  we  gave  a  simple  exact  description  of  the 
null  controllable  region  for  a  general  anti-stable  linear  system  in  terms  of  a 
set  of  extremal  trajectories  of  its  time-reversed  system.  We  also  constructed 
feedback  laws  that  semiglo bally  asymptotically  stabilize  any  linear  time  in¬ 
variant  system  with  two  exponentially  unstable  poles  on  its  null  controllable 
region.  This  is  in  the  sense  that,  for  any  a  priori  given  set  in  the  interior  of 
the  null  controllable  region,  there  exists  a  linear  feedback  law  that  yields  a 
closed-loop  system  which  has  an  asymptotically  stable  equilibrium  whose 
domain  of  attraction  includes  the  given  set.  One  critical  assumption  made 
in  [4]  is  that  the  actuator  saturation  is  symmetric.  The  symmetry  of  the 
saturation  function  to  a  large  degree  simplifies  the  analysis  of  the  closed- 
loop  system,  it,  however,  excludes  the  application  of  the  results  to  many 
practical  systems. 

The  goal  of  this  chapter  is  to  generalize  the  results  of  [4]  to  the  case 
where  the  actuator  saturation  is  asymmetric.  We  will  first  characterize 
the  null  controllable  region  and  then  study  the  problem  of  stabilization. 
We  take  a  similar  approach  as  in  [4]  to  characterize  the  null  controllable 
region.  In  studying  the  problem  of  stabilization,  we  found  the  methods 
used  in  [4]  to  derive  the  main  results  not  applicable  to  the  asymmetric  case, 
since  the  methods  rely  mainly  on  the  symmetric  property  of  the  saturation 
function.  For  a  planar  anti-stable  system  under  a  given  saturated  linear 
feedback,  we  showed  in  [4]  that  the  boundary  of  the  domain  of  attraction 
is  the  unique  limit  cycle  of  the  closed-loop  system.  The  uniqueness  of  the 
limit  cycle  was  established  on  the  symmetric  property  of  the  vector  field 
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and  the  trajectories.  We  further  showed  that  if  the  gain  is  increased  along 
the  direction  of  the  LQR  feedback,  then  the  domain  of  attraction  can  be 
made  arbitrarily  close  to  the  null  controllable  region.  This  result  was  also 
obtained  by  applying  the  symmetric  property  of  the  trajectories. 

In  this  chapter,  we  propose  a  quite  different  approach  to  solving  these 
problems  for  the  case  of  asymmetric  saturation.  In  particular,  we  will  con¬ 
struct  a  Lyapunov  function  from  the  closed  trajectory,  and  show  that  under 
certain  condition,  the  Lyapunov  function  is  decreasing  within  the  closed 
trajectory,  thus  verifying  that  the  closed  trajectory  forms  the  boundary  of 
the  domain  of  attraction.  If  the  state  feedback  is  obtained  from  the  LQR 
method,  then  there  is  a  unique  closed  trajectory  (a  limit  cycle).  We  will 
also  show  that  if  the  gain  is  increased  along  the  direction  of  the  LQR  feed¬ 
back,  then  the  domain  of  attraction  can  be  made  arbitrarily  close  to  the  null 
controllable  region.  This  result  will  be  developed  by  a  careful  examination 
of  the  vector  field  of  the  closed-loop  system. 

For  higher  order  systems  with  two  anti-stable  modes,  we  have  similar 
results  as  in  the  symmetric  case:  given  any  compact  subset  of  the  null 
controllable  region,  there  is  a  controller  (switching  between  two  saturated 
linear  feedback  laws)  that  achieves  a  domain  of  attraction  which  includes 
the  given  compact  subset  of  the  null  controllable  region. 

3.2.  Preliminaries  and  Notation 

Consider  a  linear  system 

x(t)  =  Ax(t)  +  bu(t),  (3-1) 

where  x(t)  <E  R”  is  the  state  and  u(t)  €  R  is  the  control.  Given  real 
numbers  u~  <  0  and  u+  >  0,  define 

Ua  :=  | u:  u  is  measurable  and  u~  <  u(t)  <  u+ ,  Vt  €  R  j  •  (3-2) 

A  control  signal  u  is  said  to  be  admissible  if  u  S  Ua .  In  this  chapter,  we  are 
interested  in  the  control  of  the  system  (3.1)  by  using  admissible  controls. 
Our  first  concern  is  the  set  of  states  that  can  be  steered  to  the  origin  by  an 
admissible  control. 

Definition  3.1.  A  state  xo  is  said  to  be  null  controllable  if  there  exist 
a  T  €  [0,  oo)  and  an  admissible  control  u  such  that  the  state  trajectory 
x(t)  of  the  system  satisfies  x(0)  =  xo  and  x(T)  =  0.  The  set  of  all  null 
controllable  states  is  called  the  null  controllable  region  of  the  system  and 
is  denoted  by  C. 
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With  the  above  definition,  we  have 


c=  U  {*--/ 

re[o,oo)  l  0 


e  ATbu(r)dT  :  u  £  Ua 


(3.3) 


Remark  3.1.  For  a  linear  system  with  multiple  inputs, 

x(t)  =  Ax(t)  +  Bu(t ),  (3.4) 

where  u  €  Rm,  and  £  [uj-.ufl,  u~  <  0,u+  >  0,  let  C%  be  the  null 
controllable  region  of  the  system 

x(t)  —  Ax(t )  +  biUi(t), 

then  it  is  easy  to  verify  that  the  null  controllable  region  of  the  system  (3.4) 
is 

C  =  Y^Ci  =  {x  i+x2  +  ---  +  xm:  Xi  eCi,  i  =  1,2,- 

i=  1 

Hence,  it  is  without  loss  of  generality  that  we  consider  the  single  input 
system  (3.1). 


For  simplicity,  a  linear  system  and  the  matrix  A  are  said  semistable  if 
all  the  eigenvalues  of  A  are  in  the  closed  left  half  plane;  and  anti-stable  if 
all  the  eigenvalues  of  A  are  in  the  open  right  half  plane. 

We  recall  a  fundamental  result  from  the  literature  [2, 10, 11]: 


Proposition  3.1.  Assume  that  (A,  b)  is  controllable. 


a)  If  A  is  semistable,  then  C  =  Rn. 

b)  If  A  is  anti-stable,  then  C  is  a  bounded  convex  open  set  containing 
the  origin. 


c) 


If  A  = 


Ai  0 
0  A2 


with  Ai  €  RniXni  anti-stable  and  A2  €  Rn2Xn2 


semistable,  and  b  is  partitioned  as 


h 

b2 


accordingly,  then 


C  =  Ci  xRn2, 

where  C\  is  the  null  controllable  region  of  the  anti-stable  system 
Xi(t)  =  Ai^i  +  biu(t). 
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Because  of  this  proposition,  we  can  concentrate  on  the  study  of  null 
controllable  regions  of  anti-stable  systems.  For  this  kind  of  systems, 


={-/; 


e  Arbu{r)dr  :  u  £  tia 


(3.5) 


■where  C  denotes  the  closure  of  C.  We  also  use  “S”  to  denote  the  boimdary 
of  a  set.  In  this  chapter,  we  will  derive  a  method  for  explicitly  describing 

dC  in  Section  3.  . 

In  the  study  of  null  controllable  regions  we  will  assume,  without  loss  o 
generality,  that  (A,  b)  is  controllable  and  A  is  anti-stable. 

For  a  general  system 

x-f{x,u), 


its  time-reversed  system  is 


z  =  -f(z,v). 


Consider  the  time-reversed  system  of  (3.1): 

z(t)  =  -Az(t)  ~  K*)- 


(3.6) 

(3-7) 

(3.8) 


Definition  3.2.  A  state  zf  is  said  to  be  reachable  if  there  exist 
[0,  oo )  and  an  admissible  control  v  such  that  the  state  trajec  ory  z{  ) 
the  system  (3.8)  satisfies  z(0)  =  0  and  z(T )  =  zf.  The  set  of  all  reacha  ^ 
states  is  called  the  reachable  region  of  the  system  (3.8)  and  is  denoted  y 

li¬ 
lt  is  known  that  C  of  (3.1)  is  the  same  as  71  of  (3.8)  (see,  e.g.,  [8])-  To 
avoid  confusion,  we  will  continue  to  use  the  notation  x,  u  and  C  fo 
original  system  (3.1),  and  z,  t,  and  71  for  the  time-reversed  system  (3.8). 

3.3.  Null  Controllable  Regions 

In  Section  3.3.1,  we  show  that  the  boundary  of  the  null  controllable 
region  of  a  general  anti-stable  linear  system  with  saturating  actuator  is 
composed  of  a  set  of  extremal  trajectories  of  the  time-reversed  system. 
The  descriptions  of  this  set  are  further  simplified  for  systems  with  on  y 
real  poles  and  for  systems  with  complex  poles  m  Sections  3.3.2  a 
respectively. 

3.3.1.  General  Description  of  Null  Controllable  Regions 

We  will  characterize  the  null  controllable  region  C  of  the  system  (3.1) 
through  studying  the  reachable  region  7^  of  its  time-reversed  system  (3.8). 
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Since  A  is  anti-stable,  we  have 


v  e  Ua 
v  €  Uo\ 


Noticing  that  eAr  =  e  A®  T\  we  see  that  a  point  z  in  71  is  a  state  of 
the  time-reversed  system  (3.8)  at  t  =  0  by  applying  an  admissible  control 
v  from  —oo  to  0. 

Define  the  asymmetric  sign  function  sgnQ  (•)  as 

{u+,  r  >  0, 

0,  r  =  0, 
u~,  r  <  0. 

Theorem  3.1. 

dll=^z  =  -J  eArb  sgna  (c/e'4r6)  dr  :  c#oj.  (3.9) 

H  is  strictly  convex.  Moreover,  for  each  z*  £  dlZ,  there  exists  a  unique 
admissible  control  v*  such  that 

r° 

z*  =  ~  eATbv*(r)dT.  (3.10) 

J  —  OO 

Proof.  This  can  be  proved  similarly  as  Theorem  2.3.1  in  [4].  □ 

Theorem  3.1  says  that  for  2*  e  dll,  there  is  a  unique  admissible  control 
v*  satisfying  (3.10).  From  (3.9),  this  implies  v*(t)  =  sgna(c'eAtb)  for  some 
c  7^  0  (such  c,  |Jc||  =  1,  may  be  nonunique,  where  ||  •  ||  is  the  Euclidean 
norm).  So,  if  v  is  an  admissible  control  and  there  is  no  c  such  that  v(t)  = 
sgnQ (c'eAtb)  for  t  <  0,  then 


and  must  be  in  the  interior  of  71. 

Since  sgna(kc'eATb)  =  sgna(c/ eArb)  for  any  positive  number  k,  equation 
(3^9)  shows  that  871  can  be  determined  from  the  surface  of  a  unit  ball  in 
R  .  In  what  follows,  we  will  simplify  (3.9)  and  describe  871  in  terms  of  a 
set  of  trajectories  of  the  time-reversed  system  (3.8). 
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Denote 

Sc  :=  {v(i)  =  sgna  (c'eAtb)  ,t  €  R  :  c  ^  0}  ,  (3.11) 


and  for  an  admissible  control  v,  denote 


$(t,v):=—  f  e  T^bv(r)dT.  (3-12) 

J  OO 

Since  A  is  anti-stable,  the  integral  in  (3.12)  exists  for  all  t  £  R,  so 
is  well  defined. 

If  v(t)  =  sgntt(c,ej4t6),  then 


*(*,«)  =  -J_ 


T^bv(r)dT 


=  -  f  eArb  sgna  (c'eAteATb)  dr 
J  —  OO 


€ 


for  all  t  £  R,  i.e.,  $(t,  v)  lies  entirely  on  dU.  An  admissible  control  v 
such  that  $(t,  v)  lies  entirely  on  dU  is  said  to  be  extremal  and  such  &(tyv) 
an  extremal  trajectory.  On  the  other  hand,  given  an  admissible  control 
v(t),  if  there  exists  no  c  such  that  v(t)  =  sgna(c/ej4tfe)  for  all  t  <  0,  then 
by  Theorem  3.1,  $(0,v)  £  dU  and  must  be  in  the  interior  of  11.  By 
the  time  invariance  property  of  the  system,  if  there  exists  no  c  such  that 
v(t)  =  sgn a(deAtb)  for  all  t  <  t0,  $(*,  v)  must  be  in  the  interior  of  H  for  all 
t  >  t0.  Consequently,  £c  is  the  set  of  extremal  controls. 


Definition  3.3.  vi,v2  €  £c  are  said  to  be  equivalent,  denoted  by  vx  ~ 
^2,  if  there  exists  an  h  E  R  such  that  vx (t)  —  v2(t  —  h)  for  all  t  E  R. 

The  following  theorem  shows  that  dll  is  covered  by  a  minimal  subset 
.of  the  extremal  trajectories. 


Theorem  3.2.  Let  E™  C  Ec  be  such  that  for  every  v  £  £Cy  there  exists 
a  unique  v\  E  such  that  v  ~  Vi.  Then 

on  =  |$(t,  v):  t  G  R,  v  €  .  (3.13) 

Proof.  For  any  fixed  t  €  R,  it  follows  from  (3.9)  that 


an  = 


!-J*  e~A^t~T')b  sgn0  (c'e~AteArb)  dr  :  c  £  o) 
J  e~A^t~T')b  sgn0  ( deArb )  dr  :  c  ±  o)  , 
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i.e.j  dll  =  :  v  €  £c },  for  any  fixed  t  6  R.  So  dlZ  can  be  viewed 

as  the  set  of  extremal  trajectories  at  any  frozen  time.  Now  let  t  vary,  then 
each  point  on  dlZ  moves  along  a  trajectory  but  the  whole  set  is  invariant. 
So  we  can  also  write  dlZ  =  {$(£,u)  :  v  €  £c ,  t  E  R},  which  is  equivalent 
to 

8K={<f>(t,v)  :  t€R,  ve£cy  (3.14) 

Noting  that  a  shift  in  time  of  the  control  corresponds  to  the  same  shift  of 
the  state  trajectory,  we  see  that,  if  ~  t>2,  then 

:  t  e  r|  =  {$>(t,i>2)  :  t  G  r|  . 

And  (3.13)  follows  from  the  property  of  □ 

It  turns  out  that  for  some  classes  of  systems,  £ ™  can  be  easily  described. 
For  second  order  systems,  £™  contains  only  one  or  two  elements,  so  67Z  can 
be  covered  by  no  more  than  two  trajectories;  and  for  third  order  systems, 
£™  can  be  described  using  a  parameter  that  varies  within  a  real  interval. 
We  will  see  later  that  for  systems  of  different  eigenvalue  structures,  the 
descriptions  of  £™  can  be  quite  different.  All  the  results  in  the  following 
subsections  are  easy  extension  of  the  counterparts  in  [4],  hence  the  proofs 
are  omitted. 


3.3.2.  Systems  with  Only  Real  Eigenvalues 

It  follows  from,  for  example,  [8,  p.  77],  that  if  A  has  only  real  eigenvalues 
and  e^O,  then  deAtb  has  at  most  n—1  zeros.  This  implies  that  an  extremal 
control  can  have  at  most  n—  1  switches.  It  was  shown  in  [4]  that  the  converse 
is  also  true. 

Theorem  3.3.  For  the  system  (3.8),  assume  that  A  has  only  real  eigen¬ 
values,  then 

a)  an  extremal  control  has  at  most  n  —  1  switches; 

b)  any  bang-bang  control  with  n  —  1  or  less  switches  is  an  extremal  control. 


By  Theorem  3.3,  the  set  of  extremal  controls  can  be  described  as  follows, 

)\ 

(-l)n  \  f€[i„_i,oo), 


1,  t€[-oo,!ti), 

£c  =  sgn0(±u) :  u(t)  =  {  (-1)\  t  £  [tu  ti+1), 


oo  <  ti  <t2<--  •<**_!  <  oo|  U  |u+,u_| , 
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where  u+  (or  u~)  denotes  a  constant  control  v(t)  =  u~  (or  u~).  Here 
we  allow  ti  =  ti+i  ( i  ^  1)  and  tn—  1  =  oo,  so  the  above  description  of  £c 
consists  of  all  bang-bang  controls  with  n  -  1  or  less  switches. 

By  setting  ti  =  0,  we  immediately  get  £™, 

(  (  1,  t  €  [— oo,ti), 

£?  =  <  sgntt  (±u)  :  u(t)  =  <  (-1)*,  t  €  [ti,t<+i), 

{  [  (— l)n-\  t€[<n-l,00), 

0  =  tl  <  f2  <  ■■■  <  tn— 1  <  ool  U  . 


For  each  v  €  we  have  v(t)  =  u“  (or  u+)  for  all  t  <  0.  Hence,  for  t  <  0, 
<&(t,v)  =  —  f  e~A^~T^bv(t)dT  =  -A~1bu~  (  or  -  A~1bu+). 

J  — OO 

And  for  t  >  0,  u(t)  is  a  bang-bang  control  with  n  -  2  or  less  switches. 
Denote  z+  =  -A-16k+  and  =  -A~1bu~,  then  from  Theorem  3.2  we 
have, 

Observation  3.3.1.  81Z  =  dC  is  covered  by  two  bunches  of  trajecto¬ 
ries.  The  first  bunch  consists  of  trajectories  of  (3.8)  when  the  initial  state 
is  2+  and  the  input  is  a  bang-bang  control  that  starts  at  t  =  0  with  v  =  u~ 
and  has  n-2  or  less  switches.  The  second  bunch  consists  of  the  trajectories 
of  (3.8)  when  the  initial  state  is  z~  and  the  input  is  a  bang-bang  control 
that  starts  at  t  =  0  with  v  =  u+  and  has  n  —  2  or  less  switches. 

Remark  3.2.  Since  the  trajectories  of  the  time-reversed  system  (3.8) 
and  those  of  the  original  system  are  the  same  except  that  their  directions  are 
opposite,  we  can  also  say  that  —  OC  is  covered  by  the  trajectories  of  the 
original  system  under  the  same  controls.  The  fundamental  difference  is  that 
it  is  quite  easy  to  generate  the  trajectories  with  the  time-reversed  system, 
while  it  is  unrealistic  to  get  the  trajectories  from  the  original  system.  For 
example,  suppose  that  we  have  a  trajectory  of  the  time-reversed  system 
that  starts  at  zA  under  the  control  v  =  u~ ,  then  it  goes  toward  ze  since 
z~  is  a  stable  equilibrium  under  the  control  v  =  u~ .  On  the  contrary,  if  we 
apply  u  =  u~  to  the  original  system  with  initial  condition  z~ ,  we  cannot 
get  a  reversed  trajectory  because  z~  is  an  (unstable)  equilibrium  under  the 
control  u  —  u~.  The  trajectory  of  the  time-reversed  system  from  to  ze 
under  the  control  v  =  u~  could  be  partly  recovered  by  the  original  system 
if  we  know  one  point  (except  z~ )  on  the  trajectory.  But  this  is  unrealistic. 
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Furthermore,  d7l  can  be  simply  described  in  terms  of  the  open-loop 
transition  matrix. 


&&  = 


'n— 1 


E  ±(«"  -  u+)(-iye~A^  -  sgna  (±(-l)n)  I 


Li=l 


A~lb : 


0  =  h  <  t2  •  •  •  <  in_!  <  t  <  oo 


Here,  we  allow  ti  =  t2  to  include  ±z+.  For  second  order  systems, 


=  |  ((u  —  u+)  e  At  I u  )  A  lb  :  t  €  [0,  oo]| 

LI  {((u+ -u~)  e~At  -  Iu+)  A_1b  :  t  €  [0,  oo] | .  (3.15) 


If  n  =  3,  then  one  half  of  <97 Z  =  dC  can  be  formed  by  the  trajectories 
of  (3.8)  starting  from  z+  with  the  control  initially  being  v  =  u~  and  then 
switching  at  any  time  to  v  =  So  the  trajectories  go  toward  z~  at  first 
then  turn  back  toward  .  The  other  half  is  formed  by  the  trajectories 
of  (3.8)  starting  from  z~  with  the  control  initially  being  v  ==  u+  and  then 
switching  at  any  time  to  v  =  vT .  So  the  trajectories  go  toward  at  first 
then  turn  back  toward  z~ .  That  is, 

dft  =  ^-Atz+-J^  e~A(t~T'>bu~dr-J^e~A(t-T'>bu+dT:  0<«2<t<oo) 
U  f^e~Atz~—J  e~A(-t~T)bu+dT-J^e~A{-t~T)bu~dT  :  0<i2<£<oo)  . 


3.3.3.  Systems  with  Complex  Eigenvalues 

For  a  system  with  complex  eigenvalues,  the  set  £ ™  is  harder  to  deter¬ 
mine.  In  what  follows,  we  consider  two  important  cases. 

Case  1.  A  €  R2x2  has  a  pair  of  complex  eigenvalues  a±j/3 ,  ct,  0  >  0. 

It  can  be  verified  that 

(sgna  (c'eMb)  :  c  ^  0  j  =  |sgna(sin(/3t  +  9))  :  d  G  [0,  2tt)|  . 
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Hence  the  set  of  extremal  controls  is 

£c  =  | v(t)  =  sgn0(sin (fit  +  0)),  t  <E  R  :  B  £  [0, 2ir)  | . 

It  is  easy  to  see  that 

S?  =  |v(i)  =  sgna(sin {fit)),  t  €  r| 

contains  only  one  element.  Denote  Tp  =  then  e  T  6  I-  Let 
=  (1  -  e-^y1  (  u~  +  e~aTpu+)  A_1b, 

and 


Z+  =  (1  -  e~aT”)  1  (-U+  +  e~aTpu  )  A  a6. 

It  can  be  verified  that  the  extremal  trajectory  corresponding  to  y(t)  = 
sgn  (sin (fit))  is  periodic  with  period  2Tp:  in  the  first  half  period  it  goes 
from  z~  to  z+  under  the  control  v  =  u+  and  in  the  second  half  period  it 
goes  from  zf  to  z~  under  the  control  v  —  u~.  That  is, 


dlZ 


j\-A(t-r)bu+dT  .  t€(0,rp]| 

l)^e-Atz+_j\-A( t-r)bu-dT  .  t  g  [0,Tp]| 

=  {e-Atz~-(l  -e~At)A-1bu+:  t  £  {0,TP]} 

u| e~Atz+-(l -e~M)A'~1bu~:  t  €  [0,Tp]} .  (3.16) 

Case  2 .  A  €  R3x3  has  eigenvalues  a  ±  j,3  and  ou,  with  a ,  /?,  #1  >  0. 
a)  a  =  ai.  Then  similar  to  Case  1, 

£c  =  |»(t)  =  sgn0(fc  +  sin(/3 1  +  0)),  t  £  R  :  fc  e  R,  0  6  [0,  2tt)}  . 
Since  sgna(fc  +  sin(/3t  +  0))  is  the  same  for  all  k  >  1  (or  k  <  -1),  we.have 
=  ju(t)  =  sgna(fc  +  sin  {fit)),  t  6  R  :  k  €  [-1, 1]|  • 

Each  v  €  is  periodic  with  period  2TP,  but  the  lengths  of  positive  and 
negative  parts  vary  with  k.  ®(t,v)  can  be  easily  determined  from  simula¬ 
tion.  A  formula  can  also  be  derived  for  $(t,u). 
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b)  a^ai.  Then 

£c  =  ju(t)  =  sgna  ^fcie^Ql-a)t  +  k2  sin  (fit  +  6)^j  ,  t  €  R  : 

(ki,k2)^(0,0),6e[0,2ir)}. 


It  can  be  shown  that 

£?  =  U  |u(i)  =  sgn0(sin(/3t))|  U  £&. 


where  u+  (or  u  )  denotes  a  constant  control  v(t)  =  u+  (or  u  )  and 


£ 3  =  {«(*)  =  sgntt  ( ±e^-° )*  +  sin(/?t  +  «)),t€R:  9e  [0,2tt)}  . 

(3.17) 

When  ax  <  a,  for  each  v  €  v(t)  —  u4-  (or  u  )  for  all  t  <  0,  so 
the  corresponding  extremal  trajectories  stay  at  z+  =  —A~~1bu+  (or  z"  = 
— A_1bu~)  before  t  =  0.  And  after  some  time,  they  go  toward  a  periodic 
trajectory  since  as  t  goes  to  infinity,  v(t)  becomes  periodic;  When  a\  >  a, 
for  each  v  €  ££3,  v(t)  =  u+  (or  u~)  for  all  t  >  0,  and  the  corresponding 
extremal  trajectories  start  from  near  periodic  and  go  toward  z+  or  z~ . 

Plotted  in  Figure  1  are  some  extremal  trajectories  on  dlZ  of  the  time- 
reversed  system  (3.8)  with 


'  0.5 

0 

0  ‘ 

"  1  ‘ 

0 

0.8 

-2 

,  B  = 

1 

0 

2 

0.8 

1 

For  higher  order  systems,  the  relative  locations  of  the  eigenvalues  are 
more  diversified  and  the  analysis  will  be  technically  much  more  involved. 
It  can,  however,  be  expected  that  in  the  general  case,  the  number  of  para¬ 
meters  used  to  describe  £™  is  n  —  2. 

3.4.  Domain  of  Attraction  under  Saturated 
Linear  State  Feedback 

Consider  the  open  loop  system, 

x(t)  =  Ax(t)  -f  bu(t ),  (3.18) 

with  admissible  control  u  €Ua.  A  saturated  linear  state  feedback  is  given 
by  u  =  sata(/x),  where  /  e  Rlxn  is  the  feedback  gain  and  sata(-)  is  the 
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0.5  ^ 


Figure  1:  Extremal  trajectories  on  dTZ,  au  <  a. 


asymmetric  saturation  function 

{u+,  r>u+y 
r,  r€[u“,u+],_ 
u~ ,  r <  u~. 

Such  a  feedback  is  said  to  be  stabilizing  if  A  4-  bf  is  asymptotically  stable. 
With  a  saturated  linear  state  feedback  applied,  the  closed  loop  system  is 

x(t)  —  Ax(t)  +  bsata(fx(t)).  (3.19) 

Denote  the  state  transition  map  of  (3.19)  by  4> :  (t,£o)  »— ►  x(t).  The  domain 
of  attraction  S  of  the  equilibrium  x  =  0  of  (3.19)  is  defined  by 

S  :=  \xq  G  Rn  :  lim  <f>(t,x o)  =  o)  . 

L  t— >oo  ) 

Obviously,  S  must  lie  within  the  null  controllable  region  C  of  the  system 
(3.18).  Therefore,  a  design  problem  is  to  choose  a  state  feedback  gain  so 
that  S  is  close  to  C.  We  refer  to  this  problem  as  semiglobal  stabilization 
on  the  null  controllable  region. 

We  will  first  deal  with  anti-stable  planar  systems,  then  extend  the  results 
to  higher  order  systems  with  only  two  anti-stable  modes.  Consider  the 
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system  (3.19).  Assume  that  A  €  R2x2  is  anti-stable.  For  the  symmetric 
case  where  u  =  it  was  shown  in  [4]  that  dS  is  the  unique  limit 

cycle  of  the  system  (3.19).  This  limit  cycle  is  unstable  for  (3.19)  but  is 
stable  for  the  time-reversed  system  of  (3.19).  So  it  can  be  easily  obtained 
by  simulating  the  time-reversed  system. 

However,  the  method  used  in  [4]  to  prove  the  uniqueness  of  the  limit 
cycle  relies  on  the  symmetric  property  of  the  vector  field.  There  is  no 
obvious  way  to  generalize  the  method  to  the  asymmetric  case.  In  this 
section,  we  will  present  a  quite  different  approach  to  this  problem.  Actually, 
we  will  construct  a  Lyapunov  function  from  the  closed  trajectory,  and  show 
that  the  Lyapunov  function  decreases  in  time  as  long  as  the  trajectory  starts 
from  within  the  closed  trajectory.  Therefore,  the  open  set  enclosed  by  the 
closed  trajectory  is  the  domain  of  attraction. 

Lemma  3.1.  The  origin  is  the  unique  equilibrium  point  of  the  system 
(3.19)  and  there  is  a  closed- trajectory. 


Proof.  The  other  two  candidate  equilibrium  points  are  =  ~A~lbu+ 
and  xp  =  —A  1bu  .  For  xt  to  be  an  equilibrium,  we  must  have  fxf  > 


u_r  so  that  u  —  sata(/a;+)  =  Since  A  is  anti-stable  and  (A,b) 


so  that  u  =  sata(/o;+)  —  u+ 
controllable,  we  can  assume  without  loss  of  generality  that 

0  1 
“0-1  02 


IS 


A” 


ai,a2>0,  b  = 


This  implies  that  if  / 
be  easily  shown  that 


fi  fi]  is  stabilizing,  then  /i/ax  <  1.  It  can 


fx+  =  —fA~lbu+  =  (f1/a1)u+  <  u+. 

This  rules  out  to  be  an  equilibrium  point.  The  other  candidate  x~  can 
be  ruled  out  similarly. 

The  existence  of  a  closed- trajectory  can  be  proven  similarly  as  in  [4].  □ 

Suppose  that  T  is  a  closed  trajectory.  By  the  index  theory  (see,  e.g.,  [6]), 
T  must  enclose  the  origin.  Also,  T  must  have  two  intersections  with  one  of 
the  lines  fx  =  u+  or  fx  =  u~ ,  or  both  of  them.  Otherwise  there  would  be 
a  closed  trajectory  completely  in  the  linear  region  of  the  vector  field. 


Proposition  3.2.  Denote  the  region  enclosed  by  a  closed  trajectory  Y 
as  fi,  then  H  is  convex. 


Proof.  We  start  the  proof  by  showing  some  general  properties  of  second 
order  linear  autonomous  systems, 

x(t)  ~  Ax(t ),  det(A)  ^  0. 


(3.20) 
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Denote  6{t)  =  lx(t),  r(t)  =  ||*(t)||,  then  x(t)  =  r(t) 
be  verified  that 

r  n  i  I 

A 


cos  9(t) 

[  sin#(t)  J 


Noting  that 


#  =  [  cos  6  sin  5 


[  cos#  sin#  ] 


0  1 

-1  0 


cos# 
sin  6 


,  and  it  can 

(3.21) 


0  1  ' 

COS# 

-1  0 

sin# 

=  0, 


equation  (3.21)  has  at  most  four  equilibriums  on  [0,  2tt),  which  correspond 
to  the  directions  of  the  real  eigenvectors  of  A.  If  0(0)  is  an  equilibrium, 
then  0(t)  is  a  constant,  and  x(t)  is  a  straight  line.  If  0(0)  is  not  an  equilib¬ 
rium,  then  0(t)  will  never  reach  an  equilibrium  at  finite  time.  If  it  reaches, 
the  trajectory  x(t)  will  intersect  with  a  straight  line  trajectory,  which  is 
impossible.  Hence,  if  x0  is  not  an  eigenvector  of  A,  6{t)  will  never  be  equal 
to  zero,  thus  0(t)  will  be  sign  definite.  This  shows  that  Lx{t)  is  strictly 
monotonously  increasing  (or  decreasing). 

Let’s  now  consider  the  direction  angle  of  the  trajectory,  Zi(t)  =:  7 (*)• 
Since  x{t)  =  Ax(t),  by  the  same  argument,  7(t)  also  increases  (or  decreases) 
monotonically.  We  claim  that  if  the  system  is  asymptotically  stable  or  anti- 
stable,  then  0(f)  and  j(t)  have  the  same  sign,  i.e.,  the  trajectories  bend 
toward  the  origin;  if  the  signs  of  the  two  eigenvalues  are  different,  then  ff[t) 
and  7(t)  have  opposite  signs.  This  can  be  simply  shown  as  follows.  Rewrite 

(3.21)  as, 

(3.22) 


0  = 


0 

-1 


1 

0 


Ax. 


Similarly, 


7  = 


It  is  trivial  to  verify  that  A' 
matrix  A.  So 

det(A)  , 


7  = 


x 


Ax  = 

0  1 
-1  0 

0  1  ‘ 
-1  0 


;X'A' 


0 

-1 


A  Ax. 


0  1 

-1  0 


for  a  2  x  2 


A  =  det(A)  j 

Ax  =  (3.23) 

llill2 


This  shows  that  the  claim  is  true. 

Now  we  can  apply  the  above  result  to  the  closed  trajectory  T.  We  refer 
to  Figure  2.  Assume  that  T  goes  anti-clockwrise  and  intersects  both  the  lines 
jx  =  u+  and  fx  =  u~  (the  arguments  also  apply  if  F  only  intersects  one 
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1 
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Figure  2:  Illustration  for  the  proof  of  Proposition  3.2. 


of  the  straight  lines).  Let  the  intersections  be  x(0),x(ti),  xfo)  and  x(t$). 
From  x(0)  to  x(£i),  we  have  x  —  Ax  - h  bu+ ,  which  can  be  rewritten  as 

d(x  —  xf)/dt  =  A(x  —  xf). 

By  Lemma  3.1,  x+  is  below  the  line  fx  =  u+.  So  from  x(0)  to  x(ti), 
Z[x(t)  ~x+]  increases,  and  hence  Lx(t)  increases  (since  A  is  anti-stable). 
From  x(£i)  to  x^),  we  have  x  —  (A  - f-  bf)x,  so  Zx(i)  and  Zx(t)  also 
increase  (since  A  4-  bf  is  stable).  Similarly,  Zx(t)  increases  from  x(^)  to 
x(t3),  and  from  x(t3)  to  x(0).  It  is  straightforward  to  verify  that  x(t)  is 
continuous  at  x(0),x(£i),  xfo)  and  x(t3).  Hence,  Zx(t),  the  direction  angle, 
is  monotonically  increasing  along  T.  This  implies  that  the  region  ft  enclosed 
by  T  is  convex.  O 

The  following  theorem  shows  that  under  certain  condition,  a  closed 
trajectory  T  is  the  boundary  of  the  domain  of  attraction. 

Theorem  3.4.  Let  T  be  a  closed- trajectory  of  the  system  (3.19).  Let 
the  intersections  of  T  with  the  line  {fiA^b  :  fi  €  R}  be  Xbi  and  x&2  (see 
Figure  2).  If  /x&i,/x&2  €  i.e.,  the  two  intersections  x&i  and  X£>2 

are  between  the  two  lines  fx  —  u~  and  fx  =  u+,  then  dS  —  T. 
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Proof.  Without  loss  of  generality,  we  assume  that 


-4  = 


0 

1 


di ,  >  0,  b  — 


bi 

b2  ’ 


and  /  =  [  0  1  ] .  Then  fx  =  u~~  and  fx  =  are  two  horizontal  lines 

(see  Figure  3).  Since  A  +  6/  is  Hurwitz,  we  have  bi  <  ai,  b2  <  — ^2  and 
that  the  trajectories  go  anticlockwise. 

Denote  the  region  enclosed  by  T  as  ft.  Since  ft  contains  the  origin  in  its 
interior,  we  can  define  a  Minkowski  functional 


"(*).:= 


mm 


{7  > 


0  :  x  € 


(If  ft  is  symmetric  and  convex,  k(x)  is  a  norm).  Clearly,  k(x)  =  1  for  all 
x  €  F.  Since  T  is  a  trajectory  and  the  vector  field  x  in  (3.19)  is  continuous, 
exists  and  is  continuous  along  T.  Since  ft  is  bounded  and  convex, 
it  follows  that  ^2  ^  0  for  all  x  €  T.  Note  that  js  the  gradient 

of  the  function  «(x),  so  it  is  perpendicular  to  the  tangent  of  the  curve 
T  =  {x  €  R2  :  k(x)  =  1},  which  is  x .  Therefore, 

Vl€r-  (324) 

Define  a  Lyapunov  function  as  V(x)  :=  ^ k2(x ).  It  can  be  verified  that 
for  any  constant  a  >  0, 

/c(ar)  =  atz(x) ,  V  (ax)  =  a2  V  (x) , 


and 


Since 

follows  that 


8k(x) 

dx 


x=axo 


8k(x) 


dx 


X=Xo 


k(x)  exists  and  is  continuous  for  ail  x  G  R2.  It 


dV(x) 


dx 


=  a 


dV(x) 

dx 


X=Xq 


(3.25) 


and 


dV(x) 

dx 


7^0, 


\/z  €  F. 


(3.26) 


We  conclude  that  for  all  x  6  Cl,  along  the  trajectory  of  the  system  (3.19), 


(Ax  +  hsatQ(/x))  <  0. 


(3.27) 


64 


Hu  et  ah 


This  will  be  proved  in  the  following. 


With  the  special  form  of  A,  b  and  /,  the  trajectory  T  goes  anti-clockwise. 
Suppose  that  it  starts  at  the  righthand  side  intersection  x(0)  with  fx  — 
u+  and  intersects  fx  =  and  fx  =  u~~  at  x(ti),x(t2)  and  x(t3).  We 
partition  the  curve  T  into  four  parts,  Ti  :  x(t3)  — »  x(0);  T2  :  x(0)  — ►  x(ti); 
r 3  :  x(ti)  — >  xfa)  and  I4  :  xfo)  — ►  x(t3)  (see  Figure  3).  Here  we  note 
that  it  might  happen  that  T  only  intersects  one  of  the  two  straight  lines, 
say  fx  —  u+.  In  this  case,  Ti  and  P3  are  merged  into  one  connected  curve 
and  we  don’t  have  IV  We  will  see  that  the  following  proof  can  be  easily 
adapted  for  this  case. 

1.5 


1 


0.5 


0 


-0.5 


-1 


-4  -3  -2  -1  0  1  2  3  4  5 

Figure  3:  Illustration  for  the  proof  of  Theorem  3.4. 


Let  —  1,2, 3, 4  be  the  region  enclosed  by  Tj  and  the  two  straight 
lines  that  connect  the  origin  and  the  two  end  points  of  IV 


We  now  consider  V(x)  for  x  in  the 
consider  V(axr)  for  a  €  (0, 1)  and  xr  € 
denote  dVQ ^  1  for  simplicity. 


interior  of  Q.  In  other  words,  we 
T.  In  the  sequal,  we  use  to 
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1) 


2) 


If  xr  €  Ti  U  r3,  then  axT  £  fli  U  ^3.  By  (3.25),  (3.26)  and  (3.27), 

(aAxr  +  bsata(afxr)) 

=  (Axr+bJX,)a=  (2^)  irO-0. 

If  xT  e  T2  U  T4,  then  axr  £  ft  2  U  ft  4  and  we  have 


V(atxr) 

a 


(dV(Xr)Y 


(i aAxr  4-  b  sat a(a/xr)) 


V  <9x 


=:  5(a,*r)- 


Since  for  a  fixed  sr,  (£%(*-'>)  Axr,  (8*afr*)  6  and  are  a11  constants, 
it  follows  that  #(a,  xr),  as  a  function  of  a,  is  a  bended  line.  It  bends  at 
the  point  where  afxT  =  (or  u~).  Also,  we  have  g(0,  xr)  =  g( l,xr)  =  0. 
(p(l,xr)  =  0  is  from  (3.26)).  Therefore,  for  a  fixed  xr,  we  have  either 
g(a,xr)  >  0  for  all  a  £  (0, 1)  or  g( a,xr)  <  0  for  all  a  E  (0, 1). 


Denote 

M*>-  (^)W  +  V*r),  M*,)  -  (^)V. 

Since  is  continuous  in  xr,  both  &i(xr)  and  k2(xr)  are  continuous 

functions  of  xr.  For  a  fixed  xr,  &i(xr)  is  the  slope  of  g(a,xr)  for  small  a 
when  sata(a/xr)  =  a/xr,  and  k2(xr)  is  the  slope  of  g(a>xr)  for  large  a 
when  sata(a/xr)  =  u+  (or  u~).  Since  g(a ,  xr)  is  a  bended  line  for  a  fixed 
xr  and  g( 0,xr)  =  $(l,xr)  =  0,  ki(xr)  and  k 2(xr)  must  have  opposite  signs. 

If  k2{xr)  >  0,  then  g{ a,xr)  <  0  for  all  a  .  E  (0,1);  If  k2(xr)  <  0,  then 
g(a,xr)  >  0  for  all  a  €  (0,1);  If  k2{xr)  =  0,  then  ki(xr)  must  also  be  0, 
(otherwise  we  would  not  have  #(0,  xr)  =  0).  In  the  last  case,  we  have 


b]  =0, 


(  since  fxr  ^  0  on  T2  U  F4), 


i.e.,  Axr  and  b  are  perpendicular  to  the  same  nonzero  vector  in  R2,  which 
means  that  there  is  some  nonzero  number  fi  such  that  Axr  =  (j,b>  or 
xr  =  nA^b.  This  will  not  happen  since  we  have  assumed  that  the  two 
intersections  of  F  with  the  line  {fiA~lb  :  /i  £  R}  are  between  the  two 
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straight  lines  fx  =  u~  and  fx  =  u+.  In  other  words,  the  two  intersections 
are  on  Tx  and  T3. 

Therefore,  k2(xr)  ^  0  for  all  xr  E  T2  U  r4.  If  k2(xr)  has  the  same  sign 
‘4’  on  r2  and  T4,  then 


V(axT)  =  ag(a,xr)  <0,  Vae(0,l),xr£  (r2  U  T4)  \  (ri  U  r3), 

i.e.,  V(x)  <  0  for  all  x  in  the  interior  of  fi2  and  Q4.  The  next  step  is  to 
show  that  this  is  indeed  the  case.  Actually,  by  the  continuity  of  k2(xr)  and 
that  k2(xr)  ±  0  for  all  xT  e  T2  U  T4,  we  only  need  to  find  one  point  on  T2 
and  one  point  on  r4  such  that  fc2(xr)  >  0* 

With  the  special  form  of  A  and  /,  the  line  above  the  origin  is  fx  =  u+ 

and  the  one  below  the  origin  is  fx  =  u~.  Also  a  trajectory  goes  along  T  anti- 

.  —  d\  ' 

clockwise.  Hence,  on  P2,  there  is  a  point  xr  such  that  xr  =  q 
and 


,dx  >  0 


dV(xr) 

dx 


0 

Cl 


ci  >  0. 


Note  that  the  gradient  points  outward  of  F.  Let  xr 


Xi 

xo 


,  then 


— aix2  4-  biu+ 

'  —d\  ' 

Xf  — 

X\  4  a2x 2  4-  b2u+ 

0 

So  we  have  X\  +  a2a :2  =  ~b2u+.  From  the  stability  of 


A  +  bf  = 


0  —a i  4  b\ 

1  G-2  4  b2  1 


we  also  have,  bi  <  ai,62  <  — a2  <  0.  Hence  x\  4-  c2^2  >  0*  ft  follows  that 


k2{xr)  =  [  0  ci- 


—aix2 

x\  4  a2x2 


=  ci(xi  4*  a2x2)  >  0. 


Similarly,  on  T4,  there  is  a  point  xr  such  that  xr  = 


d2 

0 


,  d2  >  0  and 


dV{xr) 

dx 


c2  >  0. 


In  particular, 


— a\x2  4-  b\u 

d2 

Xf  — 

xi  4-  a2x2  4  b2u~~ 

0 
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<  0.  Note  that  b2  <  0  and  u  <  0.  It 


—a  1X2 
Xi  +  02x2 


>0. 


So  we  have  x\  +  a2x2  —  —b2u 
follows  that 

k2(x r)  =  [  0  -Oi] 

These  show  that  there  exist  one  point  on  T2  and  one  point  on  T4  such  that 

k2{xr)  >  0.  . 

In  summary  of  the  the  above  analysis,  we  have  V{x)  <  0,  for  all  x  in 
the  inter  of  ft2  and  ft4,  and  V(x)  =  0  for  all  x  €  fti  U  ft,  It  follows  that 
no  trajectory  starting  from  within  ft  will  approach  I  o  . 

We  next  show  that  there  exists  no  closed  trajectory  within  ft.  Let  E  be 
the  line  on  the  common  boundary  of  fti  and  ft2.  Suppose  that  there  is  a 
closed  trajectory  IT  that  intersects  E  at  x0.  Note  that  Tx  must  enclose  e 
origin.  Let  the  trajectory  start  at  x0,  then  it  goes  through  ft2)ft3, ^4,^1 
and  returns  to  x0  at  some  t.  Since  V  <  0  in  the  interior  of  ft2  and  ™ 
must  have  V(x0)t)  <  V(x0,0).  This  is  a  contradiction  since  V  is  indepen¬ 
dent  of  t.  ■ 

Therefore,  all  the  trajectories  starting  from  within  ft  will  converge  to  t  e 
origin.  Since  the  trajectories  do  not  intersect  each  other  all  the  trajectories 
starting  from  outside  of  T  wffl  stay  outaide  of  it.  We  hence  conclude  that 
the  interior  of  ft  is  the  domain  of  attraction.  That  is,  di>  -  Oil  -  J.  - 

The  condition  fxbl,  fxb2  €  [*-,«+]  in  Theorem  3.4  is  always  true  in  a 
special  case  when  the  line  {nA~'b  :  p  €  R}  is  in  parallel  to  the  straight 
lines  fx  =  u~  and  fx  =  u+.  This  is  the  case  if  6i  =  0  m  the  special  fo 
A  b/f  in  the  proof  of  the  theorem.  So  in  this  case,  any  closed-trajectory  is 
the  boundary  of  the  domain  of  attraction.  Thus,  we  can  further  cone  u 
that  there  is  a  unique  closed  trajectory  (and  hence  a  unique  limit  cycle). 

In  the  next  section,  we  will  show  that  if  /  is  designed  by  the  LQR 
method,  then  the  line  {fiA^b  :  n  €  R}  is  in  parallel  to  the  straight  lines 
fx  =  u~  and  fx  =  u+  Moreover,  the  domain  of  attraction  S  can  be  made 
arbitrarily  close  to  the  null  controllable  region  C  by  simply  increasmg  t  e 
feedback  gain. 

3.5.  Semiglobal  Stabilization  on  the  Null 
Controllable  Region 

3.5.1.  Second  Order  Anti-stable  Systems 

In  this  subsection,  we  continue  to  assume  that  A  €  R2x2  is  anti-stable 
and  (A,b)  is  controllable.  We  will  show  that  the  domain  of  attraction  6 
of  the  equilibrium  x  -  0  of  the  closed-loop  system  (3.19)  can  be  made 
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arbitrarily  close  to  the  null  controllable  region  C  by  judiciously  choosing 
the  feedback  gain  /.  To  state  the  main  result  of  this  section,  we  need  to 
introduce  the  Hausdorff  distance.  Let  X i,%2  be  two  bounded  subsets  of 
Rn.  Then  their  Hausdorff  distance  is  defined  as, 

d(X i,X2)  :=  max|d(A’i,  X2),d(X2,Xi)^  , 


where 

d[Xi,X 2)=  sup  inf  ||xi-x2||. 

nexi  *26*2 


Here  the  vector  norm  used  is  arbitrary. 

Let  P  be  the  unique  positive  definite  solution  to  the  following  Riccati 
equation, 


A'P  +  PA-Pbb'P  =  0. 


(3.28) 


Note  that  this  equation  is  associated  with  the  minimum  energy  regulation, 
i.e.,  an  LQR  problem  with  cost 


J  = 


u'(t)u(t)dt. 


The  corresponding  minimum  energy  state  feedback  gain  is  given  by  /0  - 
—b'P.  By  the  infinite  gain  margin  and  50%  gain  reduction  margin  property 
of  LQR  regulators,  the  origin  is  a  stable  equilibrium  of  the  system, 

x(t)  =  Ax(t)  +  bs&ta(kfox(t)),  (3.29) 


for  all  k  >  0.5.  Let  S(k)  be  the  domain  of  attraction  of  the  equilibrium 
x  =  0  of  (3.29). 

The  following  lemma  is  a  simple  generalization  of  the  result  of  [3].' 


Lemma  3.2.  Let  um  =  min{-u  ,u+}.  Define 

Oo-{*€R Uar'i’rrSjfl}. 

Then  D0  is  in  the  domain  of  attraction  for  the  system  (3.29)  for  all  k  >  0.5. 


Theorem  3.5.  limfc_oo  d{S(k),C)  =  0. 


Proof.  For  simplicity  and  without  loss  of  generality,  we  assume  that 


A  = 


0 

1 


ai,a2  >0,  b  = 


0 

-1 
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Since  A  is  anti-stable  and  (A,  b)  is  controllable,  A,  b  can  always  be  trans¬ 
formed  into  this  form.  Suppose  that  A  has  already  taken  this  form  and 


b  = 


b2 


•  Let  V  =  [  —A  1b  —b  ] ,  then  V  is  nonsingular  and  it  can  be 


verified  that  V~1AV  =  A  and  V~lb  = 
A  and  b,  we  have, 


With  this  special  form  of 


P  =  2 


22  0 
ai 

0  0*2 


,  fo  =  [  0  2 a2  ], 


and 


A  4-  kbfo 


0  — ai 

1  a2(  1  -  2k) 


A'lb  = 


-1 

0 


Hence,  the  line  { fiA  1b  :  €  R}  is  actually  the  line  =  0  and  it  is  between 

the  two  lines  kf0x  =  u+  and  kf0x  =  u~  (i.e.,  x2  =  ^  and  x2  = 
for  all  k  >  0.5.  Therefore,  the  condition  in  Theorem  3.4  is  satisfied  for2all 
k  >  0.5  and  the  closed-loop  system  has  a  unique  limit  cycle  which  is  the 
boundary  of  S(k).  Also,  by  Lemma  3.2,  the  limit  cycle  always  encloses  the 
fixed  ellipsoid  f20-  To  visualize  the  proof,  dC ,  ClQ  and  dS(k)  for  some  k ,  are 
plotted  in  Figure  4,  where  the  inner  closed  curve  is  dS(k)  —  T,  and  the 
outer  dashed  one  is  dC . 


For  convenience,  we  proceed  the  proof  with  the  time-reversed  system  of 
(3.29), 

z(t)  =  ~Az(t)  -  bsata(kf0z(t)).  (3.30) 

Observe  that  F  is  also  the  unique  limit  cycle  of  this  system. 

Recall  from  (3.15)  and  (3.16)  that  dC  is  formed  by  the  trajectories  of 
the  system  i  =  —Az  —  bv:  one  from  z+(  or  zf)  to  or  z~ )  under  the 

control  v  =  u~  and  the  other  from  z~  (  or  z~ )  to  z^  (or  z+)  under  the 
control  v  =  u+.  On  the  other  hand,  when  k  is  sufficiently  large,  the  limit 
cycle  must  have  two  intersections  with  each  of  the  lines  kf0z  =  and 
kfoz  =  u~ .  Suppose  that  the  limit  cycle  trajectory  starts  at  the  righthand 
side  intersection  with  kfoz  =  u~ ,  goes  clockwise  and  intersects  the  two  lines 
successively  at  time  t1?t2  and  ts  (see  the  points  z(0),  z(t{),  z(t2)  and  z(t3) 
in  Figure  4).  We  also  note  that  from  z( 0)  to  z(ti)}  v  =  sata(/c/oz)  ==  u~~ 
for  the  closed-loop  system  (3.30)  and  from  z(t2)  to  z(t3),  v  =  u+.  By 
comparing  the  two  closed  trajectories  T  and  <9C,  we  see  that  the  proof  can 
be  completed  by  showing  that  as  k  — >  oo,  z(Q),z(tz)  — ►  z+(or  z+),  and 
z(ti),z(t2)  ->  ^e~  (  or  zj). 
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Figure  4:  Illustration  for  the  proof  of  Theorem  3.5. 

Note  that  kf0z  =  2ka2z2,  we  can  rewrite  the  closed-loop  system  (3.30) 


as, 

£i  —  axz2 , 

i2  =  —  z\  —  a2^2  4-  sata(2/ca22:2). 

Since  the  trajectory  goes  clockwise  and  by  (3.31),  we  have 

ii(ti)  <  0,  £2(^1)  >  0,  £1(^2)  >  0,  £2(^2)  >  0. 

With  the  particular  form  of  A ,  6,  we  have  z+  =  -A~lbu+  = 


u ^ 
0 


(3.31) 

(3.32) 

(3.33) 
and 


27  =  —A  lbu  = 


.  Let  h  =  max{[z2|  :  z  €  dn0}.  In  the  following 


proof,  we  will  consider  k  such  that 


u+ 

u 

2ka.2 

j 

2kai 

<  \h.  This  means  that 


tne  neigni  01  tne  part  ui  aio  auuvc  ^uciuw  j  iuc  'vu*'  —  ^  v  } 

is  greater  than  \h.  Since  S(k)  is  convex,  since  it  must  enclose  Qo  and  be 
inside  C,  it  follows  from  (3.33)  that  there  exists  a  constant  7?  >  0  such  that 
the  slope  of  T  at  z(tx)  and  z[t2)  satisfy: 


£•2  ftl) 

£i(ti) 


<  -Th 


£2  (*2) 
£1(^2) 


>  v- 
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Suppose  that  we  draw  a  line  that  is  tangent  to  F  at  z(t 2);  then  by  the 
convexity  of  S(k),  z(ti)  must  be  to  the  right  of  this  line.  This  implies  that 


zi(h)  >  zi{h) 


^2(^2) 


(z2(t2)  -z2{ti))7 


Case  1.  A  has  two  real  eigenvalues. 

In  this  case,  zf  —  ^  and  z~  —  ^  are  on  the  boundary  of  C. 

For  the  particular  structure  of  A  and  6,  it  can  be  verified  that  every  point 
in  C  is  to  the  right  of  z~  and  to  the  left  of  z£.  Since  z(tx)  must  be  in  C,  we 
have  zi(ti)  >  u~ .  It  follows  from  (3.37)  that  lim^co zi(ti)  =  With 
(3.36),  we  finally  have  lim*— z(ti)  =  lim^o 0z(t2)  =  z~  and  similarly, 
limjk—oo  2(0)  =  hmfc^oo  *(*3)  =  zt  * 
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Case  2.  A  has  a  pair  of  complex  eigenvalues  a  dt  jf3. 

Denote  Tv  =  then  e~AT*  =  —e~aT*>I.  First,  we  claim  that  as  A:  oo, 
t\  —>  Tp.  To  prove  this  claim,  we  recall  some  simple  facts  about  a  second- 
order  linear  system  with  a  pair  of  complex  eigenvalues, 


v  =  —Av. 


(3.38) 


For  this  system,  suppose  that  v(0)  ^  0,  then  lv(t)  is  monotonically  in¬ 
creasing  (or  decreasing).  Consider  v(£i)  =  e~Atlu(0).  If  the  trajectory 
{e”Atv(0)  :  t  €  [0,ti]}  can  be  separated  from  the  origin  with  a  straight 
line,  then  ti  <  Tp.  Now  suppose  0  <  t\  <  Tp.  If  v(ti)  and  v(0)  are  aligned, 
then  we  must  have  t\  =  Tp\  If  v{t\)  and  u(0)  tend  to  be  aligned,  then  ti 
will  approach  Tp . 


From  z( 0)  to  z(t{)^  z  =  —Az  —  bu~.  If  we  let  v  =  z  —  z~ ,  then  the 
part  of  T  from  z( 0)  to  z(t{)  is  a  trajectory  of  (3.38).  From  Lemma  3.1  we 
know  that  z“  does  not  belong  to  the  half  plane  kfoz  <  u~f  so  this  part 
of  trajectory  is  below  z~  (the  origin  in  the  v  coordinate).  Hence  we  must 
have  0  <  ti  <  Tp.  Since  z(0)  must  be  the  right  of  flo,  we  have  zi(0)  >  0  for 

sufBciently  large  k.  It  follows  that  ||v(0)||  =  is  greater 

[_  Z2\V) 

than  a  constant.  So  ||u(ti)||  is  also  greater  than  a  constant.  Note  that  as 
k—*  oo,  U2(0),U2(ti)  — >  0.  Therefore,  t>(0)  and  v(ti)  tend  to  be  aligned,  so 
we  get  lim*— oo  h  =  Tp.  Similarly,  limfc^oo(^3  -  t2)  =  Tp. 

Now  we  have 


lim  e  Atl  =  lim  e  A^3  t2^  =  e~ATp  =  —  e~aTpI. 

k — >-oo  k — ►oo 

It  follows  that,  as  k  — ►  oo, 

(z(ti)  -  Z-)  +  e~aTp  (z( 0)  -  z~) 

=  ( e~Atl  +  e~aT*l)  (z(0)  -  z~)  — ►  0, 

and 


(z(t3)  ~z+)  +  e  aT p  ( z(t2 )  -  z+ ) 

=  ( e~A<‘t3~t2'>  +  e~aT*I^  (zfo)  —  zt)  -»  0. 


Recall  from  (3.36)  that 

z{t\)  -  z(t2)  -4  0 , 
the  property  in  (3.40)  implies  that 

(z(0)  —  zf)  +  e~aT* 


z( 0)  -  z(t3 )  -*■  0, 
(z(ti)-z+)  -*•  0. 


(3.39) 


(3.40) 


(3.41) 
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u  —  —0.5  and  u+  —  1.  Then  we  have 

fo  =  [  0.12  -0.66]. 

In  Figure  5,  the  boundaries  of  the  domains  of  attraction  corresponding  to 
different  /=  k /o,  k  =  0.50005,0.6,0.7,1,2,  are  plotted  from  the  inner  to 
the  outer.  It  is  clear  from  the  figure  that  the  domain  of  attraction  becomes 
larger  as  k  is  increased.  The  outermost  dashed  closed  curve  is  dC . 

3.5.2.  Higher  Order  Systems  with  Two  Exponentially  Unstable 
Poles 

Consider  the  following  open-loop  system 

x(t)  =  Ax(t)  +  bu(t)  =  Aq  *(«)  +  ^  «(*),  (3.42) 

where  x  =  [  xf1  x'2  ]\  Xi  €  R2,x2  E  Rn,  A\  E  R2x2  is  anti-stable  and 
A<i  £  Rn  is  semistable.  Assume  that  (A,  b)  is  controllable.  Denote  the  null 
controllable  region  of  the  subsystem 

±i  (t)  =  Aixi(t)  4*  biu(t) 

asCi,  then  the  null  controllable  region  of  (3.42)  is  C\  xRn.  Given  71, 72  >  0, 
denote 

fti(7i):=  {71*1  eR2:  Xi€Ci}, 

and 

^2(72)  :=  |x2  E  Rn  :  j|z2||  <  72 1  • 

When  71  =  1,  ^1(71)  =  C\  and  when  71  <  1,  ^1(71)  lies  in  the  interior 
of  Ci.  In  this  section,  we  will  show  that  given  any  71  <  1  and  72  >  0,  a 
state  feedback  can  be  designed  such  that  ^1(71)  x  ^2(72)  is  contained  in 
the  domain  of  attraction  of  the  equilibrium  x  =  0  of  the  closed-loop  system. 

For  e  >  0,  let  P(e)  -  ^(e)  g  R(2+n)x(2+n)  be  the  unique 

positive  definite  solution  to  the  ARE 

A!P  +  PA  -  Pbb'P  4-  e2I  =  0.  (3.43) 

Clearly,  as  e  j  0,  P(e)  decreases.  Hence  lime^o  P(e)  exists. 

Let  Pi  be  the  unique  positive  definite  solution  to  the  ARE 


AiPi  +  P\Ai  -  Pi&i&iPi  —  0. 
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Then  by  the  continuity  property  of  the  solution  of  the  Riccati  equation  [15], 


lim  Pie)  = 

e— 0 


Pi  o 
0  0 


Let  /(e)  :=  -b'P(e).  First,  consider  the  domain  of  attraction  of  the 
equilibrium  x  =  0  of  the  following  closed-loop  system 

x{t )  =  Ax(t)  +  bsa.ta(f(e)x{t)).  (3-44) 


Let  Um  =  min{— It  is  easy  to  see  that 

D(e)  :=  jx  G  R2+n  :  x'P{e)x  <  4um/||b'P5(e)||2} 

is  contained  in  the  domain  of  attraction  of  the  equilibrium  x  =  0  of  (3.44) 
and  is  an  invariant  set.  Note  that  if  xo  €  D(e),  then  x(t)  £  D{e)  and 
|/(e)x(t)|  <  um  for  all  t  >  0.  That  is,  x(t)  will  stay  in  the  linear  region  of 
the  closed-loop  system,  and  in  D(e). 


Theorem  3.6.  Let  f0  =  -b[Pi.  For  any  71  <  1  and  72  >  0,  there  exist 
k  >  0.5  and  e  >  0  such  that  ^1(71)  x  f 22(72)  is  contained  in  the  domain  of 
attraction  of  the  equilibrium  x  =  0  of  the  closed-loop  system  - 

. .  .  .  .  .  ,  f.\  (  sat0(fc/oXi(t)),  x  i  D(e),  (3  45) 

x(t)=Ax(t)  +  bu(t),  u(t)  -  |  sata(/(e)x(t));  x  €  D(e).  1  '  > 

Proof.  Similar  to  Theorem  4.4.1  in  [4]  and  Theorem  4.2  in  [5].  □ 


3.6.  Conclusions 

In  this  chapter  we  have  studied  the  problem  of  controlling  a  linear  sys¬ 
tem  subject  to  asymmetric  actuator  saturation.  The  null  controllable  re¬ 
gion  of  such  a  system  is  first  characterized.  Simple  feedback  laws  are  con¬ 
structed  to  stabilize  a  system  with  no  more  than  two  exponentially  unstable 
open-loop  poles.  The  feedback  law  guarantees  a  domain  of  attraction  that 
includes  any  given  compact  set  inside  the  null  controllable  region. 
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SUMMARY 

This  paper  studies  the  classical  problem  of  output  regulation  for  linear  discrete-time  systems  subject  to 
actuator  saturation  and  extends  the  recent  results  on  continuous-time  systems  to  discrete- time  systems.  The 
asymptotically  regulatable  region,  the  set  of  all  initial  conditions  of  the  plant  and  the  exosystem  for  which 
the  asymptotic  output  regulation  is  possible,  is  characterized  in  terms  of  the  null  controllable  region  of  the 
anti-stable  subsystem  of  the  plant.  Feedback  laws  are  constructed  that  achieve  regulation  on  the 
asymptotically  regulatable  region.  Copyright  ©  2002  John  Wiley  &  Sons,  Ltd. 

KEY  WORDS:  saturation  nonlinearities;  output  regulation;  asymptotically  regulatable  region;  discrete-time 
systems 


1.  INTRODUCTION 

There  has  been  considerable  research  on  the  problem  of  stabilization  and  output  regulation  of 
linear  systems  subject  to  actuator  saturation.  The  problem  of  stabilization  involves  issues 
ranging  from  the  characterization  of  the  null  controllable  region  (or,  asymptotically  null 
controllable  region),  the  set  of  all  initial  conditions  that  can  be  driven  to  the  origin  by  the 
saturating  actuators  in  some  finite  time  (respectively,  asymptotically),  to  the  construction  of 
feedback  laws  that  achieve  stabilization  on  the  entire  or  a  large  portion  of  the  asymptotically 
null  controllable  region.  Recent  years  have  witnessed  extensive  research  that  addresses  these 
issues.  In  particular,  for  an  open  loop  system  that  are  stabilizable  and  have  all  its  poles  in  the 
closed  left-half  plane,  it  was  established  in  Reference  [1]  that  the  asymptotically  null  controllable 
region  is  the  entire  state  space.  For  this  reason,  a  linear  system  that  is  stabilizable  in  the  usual 
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linear  sense  and  has  all  its  poles  in  the  closed  left-half  plane  is  referred  to  as  asymptotically  null 
controllable  with  bounded  controls,  or  ANCBC.  For  ANCBC  systems  subject  to  actuator 
saturation,  various  feedback  laws  that  achieve  global  or  semi-global  stabilization  on  the 
asymptotically  null  controllable  region  have  been  constructed  (see,  for  example,  References  [2- 
5]).  For  exponentially  unstable  open-loop  systems  subject  to  actuator  saturation,  the 
asymptotically  null  controllable  regions  were  recently  characterized  and  feedback  laws  were 
constructed  that  achieve  semi-global  stabilization  on  the  asymptotically  null  controllable  region 
(see  References  [6-8]). 

In  comparison  with  the  problem  of  stabilization,  the  problem  of  output  regulation  for 
linear  systems  subject  to  actuator  saturation,  however,  has  received  relatively  less  attention. 
The  few  works  that  motivated  our  recent  research  [9]  on  continuous-time  systems 
were  References  [10,5,11,2],  In  References  [5,2],  the  problem  of  output  regulation  was 
studied  for  ANCBC  systems  subject  to  actuator  saturation.  Necessary  and  sufficient 
conditions  on  the  plant/exosystem  and  their  initial  conditions  were  derived  under  which 
output  regulation  can  be  achieved.  Under  these  conditions,  feedback  laws  that  achieve 
output  regulation  were  constructed  based  on  the  semi-global  stabilizing  feedback  laws  of 
Reference  [4],  The  recent  work  [10]  made  an  attempt  to  address  the  problem  of  output 
regulation  for  exponentially  unstable  linear  systems  subject  to  actuator  saturation.  The  attempt 
was  to  enlarge  the  set  of  initial  conditions  of  the  plant  and  the  exosystem  under  which  output 
regulation  can  be  achieved.  In  particular,  for  plants  with  only  one  positive  pole  and  exosystems 
that  contain  only  one  frequency  component,  feedback  laws  were  constructed  that  achieve 
output  regulation  on  what  was  later  characterized  in  Reference  [9]  as  the  asymptotically 
regulatable  region. 

In  Reference  [9],  we  systematically  studied  the  problem  of  output  regulation  for  general 
continuous-time  linear  systems  subject  to  actuator  saturation.  In  particular,  we  characterized 
the  regulatable  region,  the  set  of  plant  and  exosystem  initial  conditions  for  which  output 
regulation  is  possible  with  the  saturating  actuators.  We  then  constructed  feedback  laws  that 
achieve  regulation  on  the  regulatable  region. 

The  objective  of  this  paper  is  to  extend  the  above  results  to  discrete-time  systems.  In  Section  2, 
we  formulate  the  problem  of  output  regulation  for  linear  systems  with  saturating  actuators. 
Section  3  characterizes  the  regulatable  region.  Sections  4  and  5,  respectively,  construct  state 
feedback  and  error  feedback  laws  that  achieve  output  regulation  on  the  regulatable  region. 
Finally,  Section  6  gives  a  brief  concluding  remark  to  our  current  work. 

Throughout  the  paper,  we  will  use  standard  notation.  For  a  vector  u  e  Rm,  we  use  [ul^  and 
\u\2  to  denote  the  vector  oo-norm  and  the  2-norm.  For  a  vector  sequence  u(k)  e  Rm, 
k  —  0, 1, 2, . . .;  we  define  =  supt>0  |m(£)Ioo.  We  use  sat(-)  to  denote  the  standard  saturation 
function  sat(j)  =  sgn(j)min{l,|j|}.  With  a  slight  abuse  of  notation  and  for  simplicity,  for  a 
vector  u  e  Rm,  we  also  use  the  same  sat(w)  to  denote  the  vector  saturation  function,  i.e. 
sat(«)  =  [sat(«i )  sat(w2)  •••  sat(wm)]T. 


2.  PRELIMINARIES  AND  PROBLEM  STATEMENT 

In  this  section,  we  state  the  discrete-time  version  of  the  classical  results  on  the  problem  of  output 
regulation  for  continuous-time  linear  systems  [12]  (see  also  Reference  [13]).  These  results  will 
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motivate  our  formulation  of  as  well  as  the  solution  to  the  problem  of  output  regulation  for 
discrete-time  linear  systems  subject  to  actuator  saturation. 

2.1.  Review  of  output  regulation  for  linear  systems 
Consider  a  linear  system 

x(k  +  1)  =  Ax(k)  +  Bu(k)  +  Pw(k) 
w(k  +  1)  =  Sw(k) 

e(k)  =  Cx(k)  +  Qw(k)  (1) 


The  first  equation  of  this  system  describes  a  plant,  with  state  x  e  R"  and  input  u  e  Rm,  subject  to 
the  effect  of  a  disturbance  represented  by  Pw.  The  third  equation  defines  the  error  eeRq 
between  the  actual  plant  output  Cx  and  a  reference  signal  -Qw  that  the  plant  output  is  required 
to  track.  The  second  equation  describes  an  autonomous  system,  often  called  the  exosystem,  with 
state  weRr.  The  exosystem  models  the  class  to  disturbances  and  references  taken  into 
consideration. 

The  control  action  to  the  plant,  u,  can  be  provided  either  by  state  feedback  or  by  error 
feedback.  The  objective  is  to  achieve  internal  stability  and  output  regulation.  Internal  stability 
means  that  if  we  disconnect  the  exosystem  and  set  w  equal  to  zero  then  the  closed-loop  system  is 
asymptotically  stable.  Output  regulation  means  that  for  any  initial  conditions  of  the  closed-loop 
system,  we  have  that  e(k)  -*•  0  as  k  -*  oo. 

The  solution  to  these  problems  is  based  on  the  following  three  assumptions. 


Al. 

A2. 

A3. 


The  eigenvalues  of  S  are  on  or  outside  of  the  unit  circle; 
The  pair  (A,  B) is  stabilizable; 

The  pair 


( 


[C  Q ) 


r  a  pi\ 

’  0  S 


is  detectable. 

For  continuous-time  systems,  complete  solutions  to  the  output  regulation  problems  were 
established  in  Reference  [12]  by  Francis.  These  solutions  can  be  adapted  for  discrete-time 
systems  as  follows: 

Proposition  1 

Suppose  Assumptions  Al  and  A2  hold.  Then,  the  problem  of  output  regulation  by  state 
feedback  is  solvable  if  and  only  if  there  exist  matrices  II  that  T  that  solve  the  linear  matrix 
equations 

ns  =  ATI  +  BY  +  P 

dl  +  Q=0  (2) 

Moreover,  if  in  addition  Assumption  A3  also  holds,  the  solvability  of  the  above  Unear  matrix 
equations  is  also  a  necessary  and  sufficient  condition  for  the  solvability  of  the  problem  of  output 
regulation  by  error  feedback. 
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2.2.  Output  regulation  for  linear  systems  subject  to  actuator  saturation 

Motivated  by  the  classical  formulation  of  output  regulation  for  linear  systems,  we  consider  the 
following  plant  and  the  exosystem: 

x{k  +  1)  =  Ax(k)  +  Bu(k)  +  Pw(k ) 
w(k  +  1)  =  Sw(k) 

e(k)  =  Cx(k)  +  Qw(k)  (3) 

where  u  is  the  output  of  saturating  actuators  and  is  constrained  by  IImII*,  <  1.  A  control  u  that 
satisfies  this  constraint  is  referred  to  as  an  admissible  control.  Because  of  the  bound  on  the 
control  input,  both  the  plant  and  the  exosystem  cannot  operate  in  the  entire  state  space.  For  this 
reason,  we  assume  that  (xo,  w'o)  e  ‘S'o  for  some  focR"  x  Rr.  Let 

#0  =  {x0  e  R":  (xo,0)e^0} 


The  problem  to  be  addressed  in  this  paper  is  the  following. 

Problem  1 

The  problem  of  output  regulation  by  state  feedback  for  the  system  (3)  is  to  find,  if  possible,  a 
state  feedback  law  u  =  0(x,  w),  with  1  and  0(0,0)  =  0,  such  that 

1.  the  equilibrium  x  =  0  of  the  system 

x(k  +  1)  =  Ax(k)  +  B4>(x{k),  0) 

is  asymptotically  stable  with  STq  contained  in  its  domain  of  attraction; 

2.  for  all  (x0,  w0)  e  <&0,  the  interconnection  of  (3)  and  the  feedback  law  u  =  0(x,  w)  results  in 
bounded  state  trajectories  x(k)an  d  lim*_oo  e(k)  =  0. 

If  only  the  error  e  is  available,  the  state  (x,  vv)  can  be  reconstructed  after  a  finite  number  of  steps 
if  we  further  assume  that  the  pair  in  A3  is  observable.  But  the  initial  condition  (x0,  w0)mi  ght 
have  to  be  constrained  in  a  subset  of 

Our  objective  is  to  characterize  the  maximal  set  of  initial  conditions  (xo,  w>o),  the  largest 
possible  ^o,  on  which  the  above  problem  is  solvable  and  to  explicitly  construct  feedback  law 
that  actually  solves  the  problem  for  ^ o  as  large  as  possible. 

We  will  assume  that  ( A,B )  is  stabilizable.  We  will  also  assume  that  S  is  neutrally  stable  and  all 
its  eigenvalues  are  on  the  unit  circle.  The  stabilizability  of  (A,  B)  is  clearly  necessary  for  the 
stabilization  of  the  plant.  The  assumption  on  Sis  without  loss  of  generality.  Since  the 
components  corresponding  to  the  asymptotically  stable  modes  of  the  exosystem  will  tend  to 
zero,  they  will  not  affect  the  regulation  of  the  output.  On  the  other  hand,  if  the  exosystem  has 
unstable  modes,  either  the  disturbance  Pw  or  the  signal  Qw  will  go  unbounded.  It  is  generally 
impossible  to  drive  the  error  e  to  zero  asymptotically  with  a  bounded  control  (see  Reference 
[11])- 
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3.  THE  REGULATABLE  REGION 

In  this  section,  we  will  characterize  the  set  of  all  initial  states  of  the  plant  and  the  exosystem  on 
which  the  problem  of  output  regulation  is  solvable  under  the  restriction  that  ||u||oo^  1.  We  will 
refer  to  this  set  as  the  asymptotically  regulatable  region. 

To  begin  with,  we  observe  from  the  classical  output  regulation  theory  (see  Section  2.1)  that 
for  this  problem  to  be  solvable,  there  must  exist  matrices  II  e  R”xr  and  F  e  Rm  that  solve  the 
matrix  equations  (2).  Given  the  matrices  II  and  T,  we  define  a  new  state  z  =  x  -  IIw  and  rewrite 
the  system  equations  as 

z(k  +  1)  =  Az(k)  +  Bu(k)  -  BTw(k ) 
w(k  +  1)  =  Sw(k) 

e(k)  =  Cz(k)  (4) 

From  these  new  equations,  it  is  clear  that  e(k)  goes  to  zero  asymptotically  if  z(k)  goes  to 
zero  asymptotically.  The  latter  is  possible  only  if  (see  Reference  [11]  for  the  continuous-time 
case) 

sup  ir^woU  <  1  (5) 

k>  0 

For  this  reason,  we  will  restrict  our  attention  to  exosystem  initial  conditions  in  the  following 
compact  set 

=  {w0  e  Rr:  |r*<*)loo  =  F&wo^p,  0}  (6) 

for  some  p  e  [0, 1).  For  later  use,  we  also  denote  5  =  1  -  p.  We  note  that  the  compactness  of  if  q 
can  be  guaranteed  by  the  observability  of  (T,  S).  Indeed,  if  (T ,  S)  is  not  observable,  then  the 
exosystem  can  be  reduced  to  make  it  so. 

We  can  now  precisely  define  the  notion  of  asymptotically  regulatable  region  as  follows. 
Definition  1 

1.  Given  K  >  0,  a  pair  (z0,  w0)  e  R"  x  tT0  is  regulatable  in  K  steps  if  there  exists  an  admissible 
control  u,  such  that  the  response  of  (4)  satisfies  z{K)  =  0.  The  set  of  all  (z0,  w0)  regulatable 
in  K  steps  is  denoted  as  3ig{K). 

2.  A  pair  (zo,  wo)  is  regulatable  if  (zo,  wo)  e  0lg(K)  for  some  K  <oo.  The  set  of  all  regulatable 
(z0,wo)is  referred  to  as  the  regulatable  region  and  is  denoted  as  0tg. 

3.  The  set  of  all  (zo,  wo)  for  which  there  exist  admissible  controls  such  that  the  response  of  (4) 
satisfies  limjt-co  z(k)  =  0  is  referred  to  as  the  asymptotically  regulatable  region  and  is 
denoted  as  @tag- 


Remark  1 

Note  that  the  regulatable  region  is  defined  in  terms  of  limj._,oo  z(/c)  =  0  rather  than 
limit _.oo  e{k)  =  0.  Requiring  the  former  instead  of  the  latter  will  also  guarantee  the  closed- 
loop  stability  in  the  absence  of  w.  Like  the  continuous-time  case  [6,9],  this  will  result  in 
essentially  the  same  description  of  the  regulatable  region. 
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We  will  describe  ®g(K)y  Skg  and  in  terms  of  the  asymptotically  null  controllable  region  of 
the  plant 

v(k  +  1)  =  Av(k)  +  Bu{k),  ML  <  1 


Definition  2 

The  null  controllable  region  at  step  K,  denoted  as  ^(K),  is  the  set  of  t>o  €  R”th  at  can  be  driven 
to  the  origin  in  K  steps  and  the  null  controllable  region,  denoted  as  is  the  set  of  no  e  R"th  at 
can  be  driven  to  the  origin  in  finite  number  of  steps  by  admissible  controls.  The  asymptotically 
null  controllable  region,  denoted  as  'if',  is  the  set  of  all  v0  that  can  be  driven  to  the  origin 
asymptotically  by  admissible  controls. 

Clearly, 

I  I  V(K) 

Ke[  0,oo) 


and 


(k-i  ) 

<#(K)  =  V  A—'Bu(i) :  ML  1 
*=0 


(7) 


Some  simple  methods  to  describe  ^  and  %>a  were  developed  in  Reference  [8]  (see  also  Reference 

[6]). 

To  simplify  the  characterization  of  3tg  and  8%ag  and  without  loss  of  generality,  let  us  assume 
that 

zigR”1,  z2er 


and 


oi  r*,i 

a2  ’  b2 


(8) 


where  A\  eR”1”"1  is  semi-stable  (i.e.  all  its  eigenvalues  are  on  or  inside  the  unit  circle)  and 
A2  e  is  anti.stable  (i.e.  all  its  eigenvalues  are  outside  of  the  unit  circle).  The  anti-stable 

subsystem 

z2(k  +  1)  =  A2z2{k)  +  B2u(k)  -  B2T w(k) 


w(k  +  1)  =  Sw(k)  (9) 

is  of  crucial  importance.  Denote  its  regulatable  regions  as  StgfiK)  and  0t9l,  and  the  null 
controllable  regions  for  the  system 

v2  (k  +  1)  =  A2v2{k)  +  B2u(k) 

as  <&2(K)  and  #2-  Then,  the  asymptotically  null  controllable  region  of  the  system 

v(k+  1)  =  Av(k)  +  Bu(k) 
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is  given  by  (6a  =  R”1  x  #2  [14],  where  ^2  is  a  bounded  convex  open  set.  Denote  the  closure  of  #2 
as  #2,  then 

(  °°  ) 

^2  =  y^2-'-%M(o:iml<i 


Theorem  1 

Let  V2  e  Rn2Xr  be  the  unique  solution  to  the  matrix  equation 


-A2V2+V2S=-B2T  (10) 

and  let 

V(K)  =  V2-  A~kV2Sk 

Then, 

(a)  @g2(K)  =  {(z2,  h>)  e  R"!  x  tT0  :  22  -  V(K)w  e  W)  01) 

(b)  Mgi  =  {(z2,w)  e  R"2  x  ir0\Z2-  V2w  e  ^2}  02) 

(c)  ^  =  Rn'  x  ^fl2  03) 


Proof 

(a)  Given  (z2 0,  wo)  sE^xifo 

z2(iQ  = 


and  an  admissible  control  u,  the  solution  of  (9)  at 
/  k-\  k-\  \ 

z20  +  V  Af'1  B2u(i)  -  A2'~'B2TS'w0 

1=0  /=0 


fc  =  Ris 


(14) 


Applying  (10),  we  have 

-  V  =  V  Af~l(-A2v2  +  F2B)S '■ 

i=0  i=0 

=  V  (-^JT25''  +  A2‘ F2S,+i) 

i=0 

=  -  f2  +  ^*f2s* 

=  -  F(R)  (15) 

where  the  third  “=”  is  simply  obtained  by  expanding  the  terms  in  the  summation  and  cancelling 
all  the  middle  terms.  Thus, 

AT-l 

A~kz2(K)  =  z20  -  V(IQw0  +  V  A-‘-'B2u(i) 

i=0 

By  setting  z2{K)  =  0,  we  immediately  obtain  (a)  from  the  definition  of  @g(K) an  d  (7). 

(b)  and  (c).  The  proof  is  lengthy  and  can  be  found  in  Reference  [6].  □ 


Remark  2  . 

Given  (z0,w0),  there  exists  an  admissible  control  u  such  that  lim^o 0z(k)  =  0  if  and  only  it 
(2o,  w0)  g  @a.  Recalling  that  z  =  x  -  II  w,  we  observe  that,  for  a  given  pair  of  initial  states  in  the 
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original  co-ordinates,  (:xo,wo),  there  is  an  admissible  control  u  such  that  lim^oo  (x (k)  -  n 
w(k))  =  0  if  and  only  if  je2o  —  (II2  +  V2)wq  e  ^2.  where  II2  =  [0  /„2]II. 


4.  STATE  FEEDBACK  CONTROLLER 

In  this  section,  we  will  construct  a  feedback  law  that  solves  the  problem  of  output  regulation 
by  state  feedback  for  linear  systems  subject  to  actuator  saturation.  Our  feedback  law  will 
be  based  on  a  stabilizing  feedback  law  u=f( v),  l/'(n)|00<l  for  all  v  e  R”,  which  makes  the 
system 

v(k  +  1)  =  Av(k)  +  Bf(v(kj)  (16) 

have  an  asymptotically  stable  equilibrium  at  the  origin.  Actually,  any  feedback  of  the  form 
u  =f(v)  =  sat (Fu)  will  stabilize  the  system  locally  at  the  origin  as  long  as  A +BF  is 
asymptotically  stable.  In  References  [6—8],  we  presented  some  methods  for  designing /(p)  to 
enlarge  the  domain  of  attraction  of  the  origin.  Here,  we  assume  that  a  stabilizing  feedback  law 
u  =  f(v)  has  been  designed  and  the  equilibrium  0  =  0  of  the  closed-loop  system  (16)  has  a 
domain  of  attraction  SA  <=  cSa. 

Now  consider  the  system  (4).  Given  a  state  feedback  u  =  g(z,  w),  \g(z,  w)^  <  1  for  all 
(z,  w)  £  R"  x  -W 0,  we  have  the  closed-loop  system 

z(k  +  1)  =  Az(k)  +  Bg(z(k),  w(k ))  -  BTw(k) 

w(k  +  1)  =  Sw(k)  (17) 

Denote  the  time  response  of  z{k)  to  the  initial  state  (z0,wo)  as  z(k,zo,wo)  and  define 
y2H,  :=  ^(z0,  w0)  e  Rn  x  -To  :  lini  z(k,  z0,  w0)  =  0^ 

k~*  00 

Since  Sta  is  the  set  of  all  (z0,  w0)fo  r  which  z(k)c an  be  driven  to  the  origin  asymptotically,  we 
must  have  £AZW  <=  0laq.  Our  objective  is  to  design  a  control  law  u  =  g(z,  w)  such  that  is  as 
large  as  possible,  or  as  close  to  8%°  as  possible. 

First  we  need  a  mild  assumption  which  can  be  removed  by  modifying  the  controller  (see 
Reference  [6]).  Assume  that  there  exists  a  matrix  V  £  R"xr  such  that 

-AV+VS=-BT  (18) 

This  will  be  the  case  if  A  and  S  have  no  common  eigenvalues  (see  e.g.  p.  26  of  Reference  [16]). 
With  the  decomposition  in  (8),  if  we  partition  V  accordingly  as 

T  V\  1 
F2 

then  V2  satisfies  -A2V2  +  V2S  =  -B2Y.  Denote 

Dzw-  {(z,w)eRn  xiT0:z- Vwe8A}  (19) 

on  which  the  following  observation  can  be  made. 
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Observation  1 

(a)  The  set  Dzw  increases  as  increases,  and  if  SP  =  c€a,  then  Dzw  =  0laQ\  (b)  In  the  absence  of 
w,  (zo,  0)  €  Dz w. 

Proof 

The  fact  that  D2W  increases  as  y  increases  is  easy  to  see.  To  see  the  rest  of  (a),  we  note  that,  for  a 
general  plant,  =  R"1  x  tf2.  If  5*  =  ^a,  then  <f  =  R"'  x  #2,  and 

P2»  =  {(z,w)eR"xf'o:r-F«R"  x  <^2} 

=  {(zi,z2,w)eR"1  x  R"2  x  nr0 :  *1  -  FiiveRn,,z2  - 

=  R"‘  x^92  =  $a 

Part  (b)  is  also  clear  if  we  note  that  zo  =  *o  -  nwo  =  *o  for  wq  =  0.  □ 


With  this  observation,  we  see  that  our  objective  of  enlarging  Of  ’zw  is  simply  to  design  a  feedback 
law  such  that  Dzw  c  y„.  We  will  reach  this  objective  through  a  series  of  technical  lemmas. 

Lemma  1 

Let  u  =f(z  -  Vw).  Consider  the  closed-loop  system 

z(/c  4-  1)  =  Az(k)  +  Bf(z(k)  -  Vw(k))  -  BT  w(k) 

w(k+  1)  =  Sw(k) 

For  this  system,  Dzw  is  an  invariant  set  and  for  all  (zo,  wo)  e  Dzw,  limir-,00  (z(k) 

Proof 

Substitute  (18)  into  system  (20),  we  obtain 

z(k  +  1)  =  Az{k)  +  Bf(z(k)  -  Vw(k))  -  A  Vw(k)  +  VSw(k) 

=  A(z(k)  -  Vw(k))  +  Bf(z(k)  -  Vw(k))  +  Vw{k  +  1) 

Define  the  new  state  v  :=  z  ~  Vw,  we  have 

v(k+l)  =  Av(k)  +  Bf(v(k)) 

which  has  a  domain  of  attraction  £A.  This  also  implies  that  ST  is  an  invariant  set  for  the  n-system. 
If  (zo,  wo)  e  Dzw,  then  t>0  =  z0  -  Vw0  e  Sf.  It  follows  that 

v(k)  =  z(k)  —  Vw(k)  e  SB 

for  all  k>0  and  lim^oo  (z(k)  -  Vw(k ))  =  linut-nx,  v(k)  =  0.  □ 


(20) 

_  Vw(k))  =  0. 


Lemma  1  says  that,  in  the  presence  of  w,  the  simple  feedback  u  =f(z  -  Vw)  will  cause 
z(k)  —  Vw{k)  to  approach  zero  and  z(k)  to  approach  Vw(k),  which  is  bounded.  Our  next  step  is 
to  construct  a  finite  sequence  of  controllers 

u  =fe(z,w,cz),  £  =  0,1,2 
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all  parameterized  in  a  e  (0, 1).  By  judiciously  switching  between  these  controllers,  we  can 
cause  z(k)  to  approach  a eVw(k)  for  any  l.  By  choosing  N  large  enough,  z(k)  will  become 
arbitrarily  small  in  a  finite  number  of  steps.  Once  z(k)  becomes  small  enough,  we  will  use  the 
controller 

.  (Fz\ 
u  =  IV  4-  <5 sat'  -=- 
o 

(F  to  be  specified  later)  to  make  z(k)  converge  to  the  origin. 

Let  F  e  Rm“  be  such  that 

v(k  +  1)  =  Av(k)  +  B  sat  (Fv(k))  (21) 

is  asymptotically  stable.  Let  X  >  0  be  such  that 

(A  +  BF?X(A  +  BF)  -  X<0 

and  the  ellipsoid  £  :=  {u  e  R" :  dtATs;1}  be  in  the  linear  region  of  the  saturation  function, 
i.e.  IFuloo^l  for  all  ve£.  Then  £  is  an  invariant  set  and  is  in  the  domain  of  attraction 
for  the  closed-loop  system  (21).  Similar  to  the  continuous-time  case,  we  have  the  following 
lemma. 

Lemma  2 

Suppose  that  D  <=  R”  is  an  invariant  set  in  the  domain  of  attraction  for  the  system 

v(k  +  1)  =  Av(k)  +  Bf(v(k))  (22) 

then  for  any  a  >  0,  a D  is  an  invariant  set  in  the  domain  of  attraction  for  the  system 

v(k  +  1)  =  Av(k)  +  a  Bf  ^  @3) 

For  any  a  e  (0, 1),  there  exists  a  positive  integer  N  such  that 

aN\X'/2  Vw\2 <5,  Vw  6  tT o  (24) 

i.e.  aNVw  e  5£,  for  all  we  Wo-  Define  a  sequence  of  subsets  in  R"  x  Wo  as 
£>c2W  =  {( z ,  w)  e  R"  x  Wq  :  z  —  ae  Vw  e  a?£},  €  =  0,l,...,N 

D™  =  {(z,w)eRn  *W0:ze5£} 
and,  on  each  of  these  sets,  define  a  state  feedback  law  as  follows: 

/,(W)  =  (,-«')rw  +  «'Sa,-'Si^)\  <  =  0,1 . AT 


( Fz\ 

fN+i(z> w)  —  Tw  +  S  sat  — 

It  can  be  verified  that,  for  each  £  =  0, 1,. 1 ft(z,  w, a)!^  ^  1  for  all  (z, w)  e  R  x 
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Lemma  3 

Let  u  =  fe(z,w,  a).  Consider  the  closed-loop  system 

z(k  +  1)  =  Az(k)  +  Bfe{z(k),  w(k),  a)  -  BTw(k) 

w(k+l)  =Sw(k)  (25) 

For  this  system,  Dlzw  is  an  invariant  set.  Moreover,  if  i  =  0, 1, . . . ,  N,  then  for  all  (z<>,  wq)  e  D[w, 
hmt_,oo  (z(k)  -  ae Vw(k))  =  0;if£  =  N+l,  then,  for  all  (z0,  w0)  e  DNJX ,  lim*-,*,  z(k)  =  0. 


Proof 

With  u  =ft(z,  w,  a),  t  =  0, 1, . . . ,  N,  we  have 


z{k  +  1)  =  Az(k)  +  (1  -  a.l)BT w(k)  +  acB  sat 


(F{z{k)  - 
a 1 


-  BY w(k) 


=  Az(k)  +  a lB  sat  JVwWj\  _  ^BTw(k)  (26) 

Let  V{  =  z-  a {Vw,  then  by  (18) 

vfk  +  1)  =  Ave(k)  +  aeB  sat  (27) 

It  follows  from  Lemma  2  that  a‘S  is  an  invariant  set  in  the  domain  of  attraction  for  the  vr 
system.  Hence  Dezw  is  invariant  for  the  system  (25)  and  if  (z0,w0)  ^  Ozw>  *'®' 

vto  ==  zo  -  of  Vwq  e  a1  & 


then 


lim  (z(k)  -  aeVw(k))  =  lim  vt(k)  =  0 
k->  oo  k~*  oo 


With  u  =fN+i(z,  w)  =  IV  +  <5 sat(Fz/<5),  we  have 


z(k  +  1)  =  Az(k)  +  SB  sat 


and  the  same  argument  applies. 


□ 


Based  on  the  technical  lemmas  established  above,  we  construct  our  final  state  feedback  law  as 
follows: 

u  =  g(z,w,a,N) 

(  /n+i(z,  w)  if  (z,  w)  e  nw+1  := 

_J  fc(z,w,cc)  if  (z,  w)  e  Qe  :=  U/=t+i  BAZW,  €=0,l,...,N  (28) 

[  /(z  -  Vw)  if  (z,  w)sQ:=R”xf 0\  UjJ'  ^ 
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Since  Q,£l0,.- .,QN+'  are  disjoint  and  their  union  is  R"  +  the  controller  is  well  defined  on 
R"  xiV o.  What  remains  to  be  shown  is  that  this  controller  will  accomplish  our  objective  if  the 
parameter  a  is  properly  chosen. 

Let 


\Xx!2Vw\2 
\Xx!2Vw\2  +  1 


It  is  obvious  that  ao  g  (0, 1). 

Theorem  2 

Choose  any  a  g  (ao,  1)  and  let  N  be  specified  as  in  (24).  Then  for  all  (z0,  w'oj  e  Dzw,  the  solution  of 
the  closed-loop  system 

z(k  +  1)  =  Az(k )  +  Bg(z(k),  w(k),  ci,N)  -BY  w(k ) 

w{k+l)  =  Sw(k)  (29) 

satisfies  lim^-oo  z(k)  =  0,  i.e.  Dzw 
Proof 

The  control  u  =  g(z,  w,  a,  N )  is  executed  by  choosing  one  from/f(z,  w,  a),  t  ==  0, 1 , . . . ,  N  +  1 ,  and 
f(z  _  Vw).  The  crucial  point  is  to  guarantee  that  (z,  w)  will  move  successively  from  Q,  to  , 
fi1,.. finally  entering  ClN+},  in  which  z(/c)will  converge  to  the  origin. 

Without  loss  of  generality,  we  assume  that  (zo,  w0)  e  f2  n  Dzw,  so  the  control  n  =/(z  -  Vw) 
is  in  effect  at  the  beginning.  By  Lemma  1,  lim^oo  (z(k)  —  Vw(k))  =  0.  Hence  there  is  a  finite 
step  ko^O  such  that  z(k0)  -  Vw(k0)  e  S,  i.e.  (z(k0),w(k0))  e  D°zw.  The  condition 
( z(k),w(k ))  e  D'zw,  l  >0,  might  be  satisfied  at  a  smaller  step  ki^ko-  In  any  case,  there  is  a 
finite  step  &i  3*0  such  that 

\  v+i 

(z(M),w(^))Gn^D^  I  I  d>2W 

j=e+ 1 

for  some  t  =  0, 1, . . .  ,N  +  1.  After  that,  the  control  u  =fe(z}  w,  a)  will  be  in  effect. 

We  claim  that,  for  any  (z(k\),  w(k\))  e  G?,  under  the  control  u  =ft(z,  w,a),  there  is  a  finite 

integer  ki  >  k\  such  that  (z(k 2),  w{ki))  e  • 

Since  c  D by  Lemma  3,  we  have  that,  under  the  control  u  = fe(z ,  w,  a), 

Km  (z(k)-aeVw(k))  =  0 

k~*oo 

Since  a  g  (a0, 1),  we  have 

(1  -  a)\Xxl2Vw\<oi,  VwgtTo 

Therefore,  for  t<N 

| Xl/2(z  -  a'+1Kw)|<  |X1/2(z  -  acVw)\  +  cf(\  -  a)\XxnVw\ 

<  |  Xx/1{z  -  of  Vw) |  +  of+x  (30) 
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Since  the  first  term  on  the  right-hand  side  goes  to  zero  asymptotically,  there  exists  a  finite  k2  >  k\ 
such  that 

’  \Xx/\z(k2)  -  at+x  Vw(k2))\^a.t+X 

This  implies  that  z(k2)  -  ae+x  Vw(k2)  e  a.t+x£,  i.e.  (z(k2),  w(k2 ))  e  Dez+X . 
lf£  =  N,  then,  by  (24) 

|  Xx'2z\  sS  |  Xx/\z  -  aN  Vw) |  +  a*|  X]/2  Vw\ 

<  |  Xx!2(z  -  aNVw)\  +  <5 

Also,  the  first  term  goes  to  zero  asymptotically,  so  there  exists  a  finite  integer  k2  such  that 
\Xx!2z{k2)\  <  <5,  i.e.  (z(k2),  w(k2 ))  e  D^x . 

Just  as  before,  (z,  w)  might  have  entered  Dl+q,  q  >  1,  before  it  enters  Dc+' .  In  any  case,  there  is 
a  finite  k  such  that 

\  AT+l 

(z(k),W(k))eQ.f+q  =  D(+q  I  I 

j=e+q+ 1 

for  some  q^l.  After  that,  the  controller  will  be  switched  to  fe+q(z,  w,  a). 

It  is  also  important  to  note  that,  by  Lemma  3,  Dzw  is  invariant  under  the  control 
u  =fe(z,  w,  a).  Once  (z,  w)eflfc  Dem„  it  will  never  go  back  to  Q?,q  <t  (or  Q)  since  Sl9,q  <€  and 
Q  have  no  intersection  with  Dezw,  (but  Q9,  q  >  (,  might  have  intersection  with  Dzw).  In  summary, 
for  any  (z0,  w0)  e  Dzw,  suppose  (z0,  w0)  e  iie,  the  control  will  first  be  f({z,  w,  a)  and  then  switch 
successively  to  fei,fe2, with  €\,C2, strictly  increasing  until  (z,  w)  enters  D?+l  and  remains 
there.  Hence,  lim^  —►00  z(k)  =  0.  □ 


From  the  proof  of  Theorem  2,  we  see  that  for  all  (z0,  wQ)  e  Dzw,  the  number  of  switches  is  at 
most  N  +  2. 


5.  ERROR  FEEDBACK 

In  the  continuous-time  case  [9],  the  set  of  initial  conditions  on  which  limfc_»oo  z(k)  —  0  is  achieved 
by  an  error  feedback  can  be  made  arbitrarily  close  to  that  by  a  state  feedback.  This  is 
because  the  observer  error  can  be  made  arbitrarily  small  in  an  arbitrarily  short  time 
interval.  However,  for  discrete-time  systems,  this  is  impossible.  Suppose  that  the  pair  in 
Assumption  A3  is  observable,  then  there  is  a  minimal  number  of  steps  for  any  observer  to 
reconstruct  all  the  states.  Let  this  minimal  number  of  steps  be  n0.  We  also  assume  that  a 
stabilizing  state  feedback  law  u  =  f(v),  [/'(u)|co  ^  1  for  all  v  e  R”,  has  been  designed  such  that  the 
origin  of  the  closed-loop  system  (16)  has  a  domain  of  attraction  Scf.  By  using  the  design  of 
Section  4,  the  set 

D2W  :=  {(z,  w)  e  R"  x  tT0  :z-Vwe^} 
can  be  made  a  subset  of  y2„  with  a  state  feedback  u  =  g(z,  w,  a,  N). 
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Now  for  the  case  where  only  the  tracking  error  c  is  available  for  feedback,  a  simple  strategy  is 
to  let  the  control  u  be  zero  before  the  states  are  completely  recovered,  and  after  that  we  let 
u  —  g(z,  w,  a,  N)  as  in  (28)  i.e. 

f  0  if  k<no 

u=)  .  (3D 

^  g(z,  w,  a,  N)  if  k^zno 

The  question  is:  what  is  the  set  of  initial  states  on  which  lim*^oo  z(k)  =  0  under  the  control  of 
(31)?  The  answer  is  very  simple.  With  u  =  0,  we  have 

z(k  +  1)  =  Az(k)  -  BT  w{k) 

w{k  +  1)  =  Sw(k) 

By  applying  (18),  we  have 

(z-Vw)(k  +  1)  =  A(z  —  Vw)  (k) 

Hence, 

(z  -  Vw)  (n0)  =  A"°(z  -  Vw)  (0)  =  ^"°(z0  -  Vw0) 

For  (z0,  wo)  to  be  in  SAZW,  it  suffices  to  have  (z(no),  w(n0))  e  Dzw,  i.e.  z(n0)  -  Vw(n0)  e  SA.  This  is  in 
turn  equivalent  to 

(zo,  wo)  6  £)„  :=  {(z,  w)  6  R  x  iV0  :  A”°(z  -  Vw)  e  £A} 

In  summary,  we  have  Dzw  cz  SAZVI  under  the  control  of  (31). 

The  set  Dzw  is  close  to  Dzw  if  An°  is  close  to  the  identity  matrix. 


6.  CONCLUSIONS 


In  this  paper,  we  have  studied  the  problem  of  output  regulation  for  linear  discrete-time  systems 
subject  to  actuator  saturation.  The  plants  considered  here  are  general  and  can  be  exponentially 
unstable.  We  first  characterized  the  regulatable  region,  the  set  of  initial  conditions  of  the  plant 
and  the  exosystem  for  which  output  regulation  can  be  achieved.  We  then  constructed  feedback 
laws,  of  both  state  feedback  and  error  feedback  type,  that  achieve  output  regulation  on  the 
regulatable  region. 
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On  Semiglobal  Stabilizability  of  Antistable  Systems  by 
Saturated  Linear  Feedback 

Tingshu  Hu  and  Zongli  Lin 


Abstract — It  was  recently  established  that  a  second-order  antistable 
linear  system  can  be  semiglobally  stabilized  on  its  null  controllable  region 
by  saturated  linear  feedback  and  a  higher  order  linear  system  with 
two  or  more  antistable  poles  can  be  semiglobally  stabilized  on  its  null 
controllable  region  by  more  general  bounded  feedback  laws.  We  will  show 
in  this  note  that  a  system  with  three  real-valued  antistable  poles  cannot 
be  semiglobally  stabilized  on  its  null  controllable  region  by  the  simple 
saturated  linear  feedback. 

Index  Terms — Actuator  saturation,  antistable  systems,  semiglobal  stabi¬ 
lizability. 


I.  INTRODUCTION 


to  the  origin  asymptotically  with  bounded  controls  delivered  by  the  sat¬ 
urating  actuators.  Since  the  asymptotically  null  controllable  region  of 
a  semistable  system  is  the  whole  state  space  (if  it  is  stabilizable  in  the 
linear  sense),  it  is  possible  to  stabilize  it  globally/semiglobally.  How¬ 
ever,  the  asymptotically  null  controllable  region  of  an  exponentially 
unstable  system  is  not  the  whole  state  space,  hence  it  cannot  be  glob¬ 
ally/semiglobally  stabilized  with  saturated  feedback.  For  this  reason, 
we  generalized  the  notion  of  global/semiglobal  stabilization,  which 
was  only  suitable  for  semistable  systems,  by  giving  it  a  new  meaning 
[2],  (3].  A  linear  system  subject  to  actuator  saturation  is  globally  sta¬ 
bilizable  if  there  is  a  saturated  feedback  law  such  that  the  closed-loop 
system  has  a  stability  region  which  is  equal  to  the  asymptotically  null 
controllable  region;  it  is  semiglobally  stabilizable  if,  given  an  arbitrary 
compact  subset  of  the  asymptotically  null  controllable  region,  there  is 
a  saturated  feedback  law  under  which  the  closed-loop  system  has  a  sta¬ 
bility  region  that  includes  this  given  compact  set. 

A  first  step  toward  global/semiglobal  stabilization,  which  cannot  be 
bypassed,  is  thejsharacterization  of  the  asymptotically  null  controllable 
region.  We  made  this  first  step  in  [2],  and  then  proceeded  to  construct 
stabilizing  feedback  laws  for  semiglobal  stabilization.  In  [2]  and  [3], 
we  developed  simple|feedback  laws  for  systems  with  two  antistable 
poles,^|ira  second-order  antistable  system  the  controllers  proposed  are 
a  family/ of  saturated  linear  feedbacks  of  the  form  u  =  sat(Zci'bx)  and 
for  a  high-orderly  stem  withpnjy  two  antistable  poles,  each  controller 
faimly  seiches  between  two  saturat^ginear  feedbacks.  In  [2] 


<AUTHOR  PLEASE  NOTE:  REFERENCE  [13]  IS  NOT  USED 
IN  PAPER.  PLEASE  CITE  REFERENCE  [13]  WITHIN  TEXT 
OR  DELETE  IT  FROM  YOUR  REFERENCE  LIST.  THANK 
YOU.>There  has  been  a  long  history  of  exploring  global  or  semiglobal 
stabilizability  for  linear  systems  with  saturating  actuators.  In  1969, 

Fuller  [1]  studied  global  stabilizability  of  a  chain  of  integrators  of 
length  greater  than  two  by  saturated  linear  feedback  and  obtained  a 

negative  result.  This  important  problem  aiso  attracted  the  attention  of^  ajKW  switchin^edteck  laws  for  more 

Sussmann  and  Yang  [9],  They  obtamed  s.mi  ar  r^dts  md^d^  Rollers  are  more  cSgf*ed  than  those  of 

in  1991.  Because  of  the  negative  result  on  global  stabilizability  with'  ® 

saturated  linear  feedback  foe  only  choice  is  to  use  general  no^r  result^f  pH4],  it  is  interestingtl^a  system  with 

feedback.  In  1992,  Teel  [11]  proposed  a  nested  feedback  ^  ^  Stable  poles  can  be  semiglobally  stl&ed  with  sat- 

mchmque  for  des.gmng  nonlinear  globally  asymptoUcalljgabtlamp^^  n  In  contrast  tc,fetable  systeinsj  Vhich  can 

feedback  laws  for  a  chain  of  integrators.  This  tectoffl|was  ^  stabi]jzed  „  saturat|d  linear  feedback,  this  no.e  will 

generalized  by  Sussman,  Sontag  and  Yang  [8]  in  1»  Alternate  with  Are*  or  mnrftLtistahle  rMs  cannot  even  be 

solutions  to  global  stabilization  problem  consisting  of  scheduling,  a 
parameter  in  an  algebraic  Riccati  equation  according  to  the  size- of  . the 
state  vector  were  later  proposed  in  [7],  [10],  and 

Another  trend  in  the  development,  motivated  by  the  objec&ve  of  de¬ 
signing  simple  controllers,  is  semiglobal  stabilizability  ^ith;saturated^ 

linear  feedback  laws.  The  notion  of  semiglobal/as^mptotic&^ilizatiqjf L 

•  rMw  mated  linear  rei 

for  linear  systems  subject  to  actuator  saturation^ >^antroduceq;.in;l9J>" 
and  [6],  The  semiglobal  framework  for  stabilization  requires  feedback 
laws  that  yield  a  closed-loop  system  which  has  an  asymptotically  stable 
equilibrium  whose  domain  of  attraction  includes  an  a  pPiamgven  (ar¬ 
bitrarily  large)  bounded  subset  of  the  state  space.  In  [5]  and  [6],  it  was 
shown  that,  a  linear  system  can  be  semiglobally  stabilized  by  saturated 
linear  feedback  if  it  is  stabilizable  in  the  usual  linear  sense  and  has  alf 
its  poles  in  the  closed  left-half  plane. 

It  is  notable  that  all  the  results  mentioned  above  pertain  to  systems 
whose  open-loop  poles  are  all  in  the  closed  left-half  plane.  Such  sys¬ 
tems  are  said  to  be  semistable.  If  a  system  has  some  open-loop  poles 
in  the  open  right-half  plane,  then  it  is  exponentially  unstable.  A  system 
with  all  its  poles  in  the  open  right-half  plane  is  said  to  be  antistable.  It  is 
evident  that  the  domain  of  attraction  has  to  be  a  subset  of  the  asymptot¬ 
ically  null  controllable  region,  the  set  of  initial  states  that  can  be  driven 


ti  n 

^  jbally  j 

showthaf  el  system  with  three  or  moreiantistable  poles  cannot  even  be 
semigwbally  stabilized  by  saturated  liriear  feedback^ 

The\remaining  of  this  note  is  organized  as  follows.  Section  II  re¬ 
views  some  results  on  the^ymp^  region  and 


tion  IV. 


e  concluding  remarks  are  given  in  Sec- 


iARy  Results  and  Some  Algebraic  Tools 


:ii®RELB 

:  recaliffibm  [2]  ^description  of  the  asymptotically  null  control- 
region!  Consider  a  single-input  linear  system  subject  to  actuator 


saturation' 


i  =  Ax  bu ,  x  6  Rn,  u  £  R,  |u|  <  1. 


(1) 
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Assume  that:,(A,  b)  is  controllable  in  the  usual  linear  sense.  Then  the 
asymptotically'  null  controllable  region  is  the  same  as  the  null  control¬ 
lable  region,  which  is  the  set  of  initial  states  that  can  be  driven  to  the 
origin  in  finite  time.  We  use  C  to  denote  the  null  controllable  region  of 
system  (1).  It  is  known  that  if  A  is  semistable,  then  C  =  Rn  and  if  A  is 
antistable,  then  C  is  a  bounded  convex  open  set  containing  the  origin  in 
its  interior.  In  this  note,  we  will  restrict  our  attention  to  third-order  an¬ 
tistable  systems  with  only  real  poles.  For  such  a  system,  the  boundary 
of  the  null  controllable  region  is  (see  [2]) 


2e’ 


-  A<2 


-f-  2e 


A~lb 


0  <  ti  <  <2  <  oo]  .  (2) 
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Fig.  1  illustrates  a  typical  shape  of  C  with  a  bunch  of  curves  on  at . 

Denote  2"  \ 

££+  =  {  (-2e-At>  +2e~Ml  -  /)  A~lb  :  0  <  h  <  t2  <  oo]  ^ 

dC~  =  -  dC+  1 

dC°  =  {  (±(~2e^^t2  +  /)  A"1*  :  0  <  £2  <  oo  j  . 

It  can  be  verified  that  dC  =  BC+  U  dC  U  dC°  and  dC+ ,  6C  and  dC  -3;, 

are  disjoint.  In  Fig.  1,  the  solid  curves  are  on  dC +  and  thedashed  ones  10 

are  on  dC~ .  The  two  smooth  curves  connecting  zf  and  *7  (one  on  the  5 

highest  boundary  and  the  other  on  the  lowest  boundary)  form  dC  .  It 
has  been  shown  in  [2]  that  all  the  curves  are  trajectories  of  the  system 
(1)  under  controls  that  only  take  values  of  1  and  -1.  They  are  called 

extremal  trajectories.  The  solid  curves  on  dC+  are  trajectories  of  die  ^  ^  $C  of  a.  third-order  system, 
system  (1)  under  the  control  u  =  1  and  those  on  dC  are  trajectories 
under  the  control  u  =  -1.  The  curve  on  the  highest  boundary  is  a 
trajectory  going  from  zc"  to  z+  under  the  control  «=-land  the  one  for  some  c,  i.||, 
on  the  lowest  boundary  is  a  trajectory  going  from  zf  to  ze  under  the  -aJcW  - 

control  u  =  L  \  Mf  & 

From  the  definition,  we  see  that  dC+  and  dC  are  smooth  surfaces  jg|# 

and  dC°  is  a  closed  curve  connecting  dC+  and  dC~ ,  i.e.,  dC°  is  com-  This^n  be  writt* 

posed  of  all  the  common  limit  points  of  dC+  and  dC~ .  _  .  ^Wk-Ati 

Since  C  is  an  open  set,  dCCiCis  empty.  Here,  we  summarize  some  A  ^0 

facts  from  [2].  #  MMy 


facts  from  [2].  M$y  l§f4,  Jpf  tel  *  ,  At  f 

Fact  2  1  ■  Under  the  constraint  that  \u\  <  1,  the  following  hold  true^:-^hich  contradicts  Lemma-2.1.  Here,  we  note^iat  4;and  e  commute. 

1)  All  to  states  in  C  can  be  driven  to  the  origin.  Ncwgthat  *(B|J|g§ ?2, 3,  are  not  on  Ae  W  stnd^t 

2)  All  the  states  outside  ofCUdC  will  grow  unbounded  no  matter  uniquely  determine  a. plane.  Let  this  plane  be  %x  ^  Suppose,  o 

what  control  is  applied.  ^  c^tSy,  that  *£<)  is  also  in  this  plane,  then  ^ 

3)  All  the  states  on  dC  cannot  be  driven  to  the  interioraof  C.  Tpe  Jjj&  r/'r-'f  tll«* -Wlw 

only  way  to  keep  them  bounded  is  to  make  them  staypri  dC  with;^^  Jfxih)  -  fx(t2)  -  fxgp  j 

a  control  u  =  1  oru  =  -l.Forx(O)  €  dC+ ,  ttfe.only  control  \>7(.  £§  .  If  .  .11  e  (u  ts  and 

to  keep  x(t),t  €  [0, e)  for  some  e  >  0  on  dC&S  =  1  ai^for  ByTmeaft  ya  ue  theorem,  there  ex.st^6  (<t ,t2^  €  (h,U) 

x(0)  6  dC~,  the  only  control  is«=  -1.^  Mf  ts®#’ U)  such  *at  ^  m.  Jff 

From  Fact  2.1,  we  know  that  CU  dC  is  the  larg«|^ound^^^t  that  » 

can  be  rendered  invariant  by  means  of  admissible  controls*. A  t  K  M 

The  basic  fact  we  will  use  to  prove  our  mam result  is  segment^ .  \f  fe 

on  dC°  is  three  dimensional,  i.e.,  it  cannot  b^fgjnto  any  plane.  Befoje ;  ^  equjvalent-'(o  M  @ 

proving  this  fact,  we  need  an  algebraic  result  wfiich will  be  used  seyerab  | .  /  V;;.  J| 

_ i-  4-u:~  ** _ n 


m f 

(e-$*:?e-Ai*)  A-lb  -  c(e~At 2  -  e"^1)  A~lb  =  0. 

^  M"  1  v  ; 


This  ciin  be  written,!a|;r 


MW 


_A(t3— *i)^ 


times  in  this  note.  ^  ~  y  ?lSr  . 

Lemma  2 A:  Suppose  that  (^4, 6)  is  controllable,  >Pe|R-  is^anU- 
stable  and  A  has  no  complex  eigenvalues.  Let  <1,  f2,  f3^^fetinct  real 
numbers.  Then,  for  all  (fci ,  fc2,  ^3)  7^  (0, 0, 0) 


u3  6  =  0. 


piis  equality  can  beyyritten  as 


m  /[e- 


Proof:  See  Appendix  A. 

We  note  that,  if  A  has  complex  eigenvalues  a±j/3  and  (fi ,  t2 ,  t3 )  = 
(vNi/faitfo/frvNz/P),  where  NUN2  and  7V3  are  integers,  there 
may  exist  (fc1}  /c3)  #  (0,0,0)  that  satisfy  (3).  For  instance,  suppose 

that  A  has  eigenvalues  1,1  ±  j  1.  Let  fi  =  0,f2  =  =  ^7r* 

ki  =  1,  k2  =  0,  A:3  =  — e“2ir,  then  kieMl  +k2eAt2  +  kze  *3  =  0. 

Proposition  2A:  Let 


"%lijch  implies  that  the  3  x  3  matrix 


x(f)=  (-2e“A<  + 


If  fi,f2,*3  and  U  are  distinct  numbers,  then  x(U),i  =  1,2, 3, 4.  are 
not  in  the  same  plane. 

Proof:  For  simplicity,  assume  that  £1  <  £2  <  £3  <  £4.  We  first 
show  that  x(£i),  t  =  1, 2, 3,  are  not  on  the  same  straight  line.  Suppose, 
on  the  contrary,  that  they  are  then 

x(£3)  -  *(£2)  =  c(x(£2)  -  *(£1)) 


m  =  e  xb  e  2o  e  j 

is  singular .  This  again  contradicts  Lemma  2.1.  Hence  we  conclude  that 
x(ti),  i  -  3, 4,  are  not  in  the  same  plane.  □ 

Recalling  that 

dC°  =  |±  (— 2e— At  +  /)  A_1fc  :  0  <  t  <  00  J 

Proposition  2.1  implies  that  any  segment  of  dC°  is  three  dimensional 
and  cannot  be  placed  in  one  plane. 

HI.  Main  Results 

For  an  x0  e  R3  and  a  positive  number  r,  denote 

B{xQir)  =  {x  £  R3  :  ||x  -  ar0||  <  ?*} 
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where  |]  ■  ||  is  the  Euclidean  norm.  We  use  sat(*)  to  denote  the  standard 
saturation  function,  i.e.,  sat(u)  =  sign(u)  min{l,  |u|}.  Let  X\  and  X2 
be  two  subsets  of  Rn.  Then  their  distance  is  defined  as 

d(XuX2)~  inf  H*1-X3||. 

In  terms  of  5C+,  dC~  and  dC° ,  the  space  R3  can  be  divided  into 
three  subsets 

E+  =  {7x  :  7  £  (0,  oo),x  £  dC+} 


=  {jx  :  7  £  [0,  oc),  x  £  dCQ  }  . 


d(B(x2,r2),E°)  >  </2,whered2  is  also  a  fixed  positive  number.  Here, 
forx  G  £(x2,r2),  |sat(Fx)|  <  1/2. 

If  we  let  d0  =  min{di,  d2}  and  r0  =  min{ri ,  r2},  then  the  result 
of  Lemma  3.1  readily  follows.  C 

To  prove  Theorem  3.1,  we  need  to  show  that,  under  the  control  of 
any  feedback  u  —  sat(Fx),  there  exists  a  ball  in  C  of  radius  greater 
than  a  fixed  positive  number,  such  that  all  the  trajectories  starting  from 
the  ball  will  go  out  of  C  and  diverge.  We  will  use  Lyapunov  function 
analysis  to  show  this  result.  The  Lyapunov  function  is  defined  in  terms 
of  dC  as  follows: 

V(x)  :=  7  >  0,  such  that  ^  £  0C  (orx  £  jdC).  (4) 


_ ,  ,  ,  ,-,0  •  oince  u  is  a  ouunueu 

We  see  that  E+  and  E  are  simply  connected  open  sets  and  E  is  a  ^  *  unique  intersec 

surface  consisting  of  the  common  limit  points  of  E+  and  E~ .  In  other  ^  can  uniqueh 

words,E+ and  E- are  connected  by  E°.  a  well-defined  posith 

Theorem  3.1:  A  third-order  antistable  system  with  real  poles  cannot  c  .  V(xh=  1 

be  semiglobally  stabilized  by  saturated  linear  feedback  on  its  null  con-  ^ee  ^at  gMx) 

tollable  region  C.  Specifically,  for  any  saturated  linear  feedback  law  ^  ^  Som?xQ  then 
u  —  sat(Fx) ,  there  exists  a  ball  where  r*  >  0  is  inde- 

pendent  of  F,  such  that  all  the  trajectories  starting  from  B(x* ,rm)  will  ,0$  j 

grow  unbounded. 

To  prove  Theorem  3.1,  we  first  examine  the  difference  between  the  ^ 
control  under  a  saturated  linear  feedback  and  the  control  that  is  required  Jo  see  this,  note  that 
to  keep  the  state  bounded.  Unlike  the  case  for  a  second  order  system, 1 ' 
here  for  a  third  order  system,  there  is  always  a  ball  of  fixed  size  where  V  /  ^ 

the  difference  between  the  two  controls  is  greater  than  a  fixed  posjtivp  V  Uif0  +  | 

number.  The  result  is  stated  in  the  following  lemma.  - kJlM, 

Lemma  3.1:  There  exist  positive  numbers  r0  and  do  such  that  for,  ^ 

any  F  €  Rlx3,  there  is  a  ball  £(x0,  r0),  where  x0  G  5Cj|such  diaK^^  /Ig? 


Since  C  is  a  bounded  convex  open  set,  any  ray  starting  from  the  origin 
has  a  unique  intersection  with  dC  and  hence  any  vector  in  the  state 
space  can  be  uniquely  scaled  to  be  exactly  on  dC.  Therefore,  V (x)  is 
a  well-defined  positive-definite  function. 

Clearly,  V  (x|v=  1  for  all  x  £  dC  and  V (x)  <1  for  all  x  £  C.  We 
also  see  thatj§px)  =  aV(x)  for  any  a  >  0.  Moreover,  if  dV/dx 


AW 

SydX  *=®*0 


dx 

\x=x0 


(  mi  > 

yLx0+  Ik 


■WV(ax0) 


d(5(xo,ro),E°)  >  do  andsat(Fx)  <  1/2  for  all  x  £ 

Proof:  For  an  F  £  Rlx3,  denote  the  distance  between  the  two 
planes  Fx  =  1  and  Fx  =  -1  by  g(F).  By  Proposition  2.1,  50J$ 
a  three  dimensional  closed  curve.  So  there  exists  fa  minimal  distance 
go  between  Fx  =  1  and  Fx  =  -1  such  that  allies  completely 
between  these  two  planes.  In  other  words,  ij.  $(F)  So , then 

the  total  length  of  the  segments  of  dC°  Wft  ch  are  in 'the  Saif  space 
Fx  <  -1  must  be  greater  than  a  positive  number  depending  only  qrij 


^and,.the  aforementioned  equality  is  also  true  if  wefreplace 


r  o^|pT  o 

A  "  or  0 


veen  these  two  planes.  In  other  wonls,|^E)  then 

total  length  of  the  segments  of  8C  winch  are  m^the  half  spac^gg^  x  g  E+  jgy,  x  6  tf&r  {dv/dx)  #  0. 

<  "I  must  bc  &*** 151311  a  P°sltlve  number  depending^  my  ..  m  r,n  hp  „ JBS. seA  „ 


gi.  Also  by  Proposition  2.1,  there  are  no  moreThan  two  segihents^pf 
{x(t)  =  (-2e~At  +  I)A~xb  :  0  <  t  <  oo}  wlijpkare  in  fhehilf 
space,  otherwise,  there  would  be  four  points  x(r{),T^=;i,  2, 3,4,  in 
the  plane  Fx  =  —1.  Hence,  there  is  a  segment  of  dC%  with  length 
greater  than  a  fixed  positive  number,  that  is  completely  in  thehalf  space 


Proof:  Every  fx  £  can  be  expressed  as 


dxSffidx 
dy  dt\  dt2 


the  plane  Fx  =  — 1.  Hence,  there  is  a  segment  of  SC^wth  length  ^  ,0  <  tl<t2<  oo.lt  follows  from  the  definition 

greater  than  a  fixed  positive  number,  that  is  completely  in  tbehalf  space  Js*  ()  Jte  We  ^  is  analytic  fo  7,  f ,  and  f  2 .  Moreover 

Fx  <  -l.  /■-  y  m  ip 

Let  us  first  consider  an  F  such  that  g(F)  <  l/2^0-  By  the  fore-\-.; Jg/'  "  ’  dj ' 

going  arguments,  there  is  a  segment  of  dC°,  with  length  greater  than  dx-T  dti 

lo  >  0,  that  is  completely  in  the  half  space  Fx  <  —1.  Since  dC°  is  dt2 

a  compact  set  and  any  segment  on  it  is  three  dimensional,  the  largest 
distance  from  a  point  of  the  segment  to  the  plane  Fx  =  -1  is  greater  where  \  §*  ^ 
than  a  fixed  positive  number.  Recalling  that  dC°  is  the  closed  curve  f^x^x  "5x1 

that  connects  dC+  and  dC~ ,  we  know  that  there  is  a  simply  connected  T  =  oT  ^7“ 
region  on  the  surface  of  dC+  that  is  in  the  half  space  Fx<-land  .TisJ 

the  surface  area  of  this  region  is  greater  than  a  fixed-positive  number.  _  /  2e~At*  +  2e~Atl  -  l)  A-1  b  :  -  27e~>Ul&:27e''>U2  b 
It  follows  that  there  exists  a  ball  B(xi,ri)  with  x\  £  dC+  and  r\  a  V  J 

fixed-positive  number  such  that  B(x\ ,  ri )  is  in  the  half  space  Fx  <  —  1 

and  d( B[x i ,  ri),  E°)  >  d\ ,  where  d\  is  also  a  fixed  positive  number.  We  claim  that  T  is  nonsingular.  This  can  be  seen  as  follows.  For  sim- 

Here,  for  x  6  B(xur x),  sat(Fx)  =  -1.  plicity,  consider  an  x0  G  5C+,  then  7=1.  Applying  Lemma  2.1,  we 

Next,  we  consider  an  F  such  that  g(F)  >  1/2 gQ.  Then  there  ex-  see  that  dx/dh  =  -2 e~Atlb  and  dx/dt2  =  2e  are  indepen- 

ists  a  segment  of  dC° ,  of  length  greater  than  a  fixed-positive  number,  dent  and  they  determine  a  plane  fx  =  1  that  contains  x0 .  Since  dC  is 

5  which  is  between  the  two  planes  Fx  =  —1/2  and  Fx  =  1/2.  Fol-  smooth,  this  plane  is  tangential  to  dC+  at  x0.  Since  C  is  a  bounded 

lowing  similar  arguments  as  in  the  previous  paragraph,  there  is  a  ball  convex  set  containing  the  origin  in  its  interior,  this  plane  fx  =  1 

F(x2s  r2)  with  x2  G  dC+  and  r2  a  fixed-positive  number  such  that  does  not  contain  the  origin.  Hence,  the  vector  from  x0  to  the  origin, 

B(x2]  r2)  is  between  the  two  planes  Fx  =  -1/2  and  Fx  =  1/2  and  -x0  =  -(-26^  +  -  I)A~lb,  must  be  independent  of  the 


■  27e  Mlb: 2~te~ 


We  claim  that  T  is  nonsingular.  This  can  be  seen  as  follows.  For  sim¬ 
plicity,  consider  an  x0  G  5C+,  then  7=1.  Applying  Lemma  2.1,  we 
see  that  dx/dfi  =  -2 e~Atlb  and  dx/dt2  =  2 e~At2b  are  indepen¬ 
dent  and  they  determine  a  plane  fx  —  1  that  contains  x0 .  Since  5C+  is 
smooth,  this  plane  is  tangential  to  dC+  at  xo.  Since  C  is  a  bounded 
convex  set  containing  the  origin  in  its  interior,  this  plane  fx  =  1 
does  not  contain  the  origin.  Hence,  the  vector  from  x0  to  the  origin. 


-I)A  1  b ,  must  be  independent  of  the 


4 
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two  vectors  that  determine  the  plane.  That  is,  the  three  column  vectors 
in  T  are  independent. 

Now  that  T  is  nonsingular,  we  have 


From  Fact  2.1,  we  know  that  if  a  control  it  =  1  is  applied  at  x  G 
aC+,  the  trajectory  will  stay  on  dC+  and  V{x)  will  remain  to  be  L 
Hence,  for  x  E  3C+, 


dj 

dti 

L  dt%  j 


=  T~ldx. 


It  is  also  clear  that  T  and  T"1  are  continuous.  Hence,  7,  <1  and  <2  are 
continuously  differentiable  in  x  for  x  E  E+ .  Therefore,  V (x)  =7  is 
continuously  differentiable  in  x  for  x  E  E+. 

Noting  that  V  (x)  =  7,  we  have 


av_ 

dx 


=  ([1  0  0]T-1) 


and 


Since  ( dV/dx)Tb  ^  0  and  any  control  u  <  1  is  unable  to  bring  a  state 
on  dC+  into  a  smaller  level  set  71 C,  71  <  1,  we  must  have 

for  all  it  <  1.  This  implies  that  (dV/dxfb  <  0  for  x  £  dC+  and  also 
for  x  E  E* .  It  follows  from  (6)  that: 


Suppose  on  the  contrary  that  ( dV]dx)T  6=0,  then 


6  <  —r;,  Vx  E  B(x0iro). 


(8) 


r~16  = 


o 

ki 

l>J 


By  (5)  andtSlf  if  a  control  u  =  7  =  V(x)  is  applied  at  x  E  7^+>  we 

willhav^r 

UW 


for  some  (fci,  &2)  i1  (0, 0).  It  follows  that: 


m\  a* +{°p\w^= 0. 

mPx)  £  a  dx  /  4 


(9) 


’0 

b  =  T  h 

_&2  J 

which  contradicts  Lemma 


=  -2kiye~Mlb  +  2k2'fe-At2b 


2.1.  Therefore,  we 


{dVjdxf  b  #  0  for  all  x  6  E+. 

Since  (dV/dx)7  b  is  continuous  in  E+,  from  Lemma‘3.2,  we  con¬ 
clude  that  (dV/dx)T  b  either  “>  0”  or  “<  0”  in  E+^and  for  anyeom- 
pact  subset  of  E+,  |  (dV/dxf  6|  is  greater  than;rpositive  nuinber. 
Now  we  are  ready  to  prove  the  main  result  of  this'riote^ 

Proof  of  theorem  3.1:  Let  F  6  R.x>^tbe  an  afbitfa^feedback 
gain  matrix.  From  Lemma  3.1,  we  know  tha|ffiere  alwaysprists  a  ball/ 
S(xo,r0),io  6  dC+,  such  that  sat(Fx)  <  ly.2forallx'e 
and  rf(B(xo,ro),B#)  >  do.  Here,  do  and  r0  are' independent  of 
Since  B(x0,r0)  contains  one  point  x0  in  E+  ‘and'has  a  distance 
greater  than  do  from  E°,  we  have  B(xo,ro)  C  E+ .  , Without  loss  of 
generality,  assume  that  B(xo,  ro)  C  O  5/4 C  \  3/4C20therwise, 
we  can  choose  a  smaller  r0.  Let  M  be  the  maximal  compact  set  in 
E+  n  5/4C  \  3/4 C  such  that  d(M,  E°)  =  d0.  By  Lemma  3.2,  there|‘ 
is  a  positive  number  77  such  that 


we  have 

Mal(Fx)  ‘  v(x)  -  LpAsm* 

HI5'"  ip*  'Vv,  . 

Jfifollows  froin(9),  (8),  and  (10)  that:/"  ^ 

^  jr  |a 

*«%lr  fdv\T 


§6  sat  (Fx) 


bv(x) 

\dx)  m  \dxj 
&  WfH  lat(Fx)-V(x)) 

OX  J 


%=(| ^%»*Fx)-V(z)) 


lin{  (S’)  6  :*6Ad}>9. 


Since  <2(#(x0,r0),E0)  >  efo,  we  must  have  5(x0,ro)  C  M.  There* 
fore 


f|br  all  x  e  Bfxo ,  r0 ) .  We  see  that  there  exists  a  positive  number  N  such 
^hl^ll^ltS^  for  all  x  E  5/4 C  under  any  saturated  feedback  control. 
Hetee!  jiere  exists  a  to  6  (0,  4/jj)  and  anr,  €  (0,  r0)  independent  of 
xo ,  such  that  all  the  trajectories  starting  from  B(x0,  n)  will  stay  inside 
B(x0,^i|orf  6  [0,to].  Therefore,  V (x(i0))  -  V(x(0))  >  i?/4f0.  ' 

Also,  there  exists  a  r2  E  (0,n)  such  that 

V 


6  >  *?,  Vx  E  #(x0,r0). 


(6) 


#(xo,  r2)  C  E+  \ 


(*-  t)c- 


Consider  the  derivative  of  the  Lyapunov  function  V  (x)  along  the 
trajectory  of  the  system 


x  =  Ax  4*  6  u. 


We  have 


Ax  + 


bu. 


Clearly,  for  all  x(0)  E  B(xo,r2),  y(x(0))  >  1  —  7?t0/4.  Hence, 
for  any  trajectory  starting  from  ^(xo,^),  we  have  V{x{tn))  > 
y(x(0))  +  77/4*0  >  1,  which  means  that  the  trajectory  has  gone  out 
of  dC  at  to  and  will  diverge  by  Fact  2.1. 

It  is  easy  to  see  that  there  exists  a  ball  B(x*,r+)  C  B(x o,  r2)  fl  C, 
with  r*  greater  than  a  fixed  positive  number.  In  summary,  no  matter 
what  F  is,  there  always  exists  a  ball  B(x* ,  r*)  C  C  from  which  the  tra¬ 
jectories  will  diverge  under  the  saturated  linear  feedback  u  =  sat(F x). 
This  completes  the  proof.  O 
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IV.  Conclusion 

We  have  shown  in  this  note  that  a  third-order  antistable  system  with 
real  eigenvalues  cannot  be  semiglobally  stabilized  with  saturated  linear 
feedback.  The  study  is  based  on  examining  a  Lyapunov  function  de¬ 
fined  in  terms  of  the  null  controllable  region.  The  level  sets  of  the  Lya¬ 
punov  function  are  the  null  controllable  region  scaled  by  positive  num¬ 
bers.  The  main  idea  is  to  show  the  existence  of  a  ball  inside  the  null  con¬ 
trollable  region,  with  radius  greater  than  a  fixed-positive  number,  from 
which  the  Lyapunov  function  will  grow  unbounded.  The  increasing  of 
the  Lyapunov  function  is  caused  by  the  difference  between  the  control 
u  =  sat( Fx)  and  the  one  that  is  required  to  keep  the  state  within  a  level 
set.  The  difference  between  the  two  controls  cannot  be  reduced  to  an 
arbitrarily  small  level  because  the  two  surfaces  dC ^  and  dC  cannot 
be  separated  with  a  plane,  or,  the  closed  curve  that  connects  these  two 
surfaces  is  three  dimensional.  For  systems  with  complex  eigenvalues, 
if  we  define  dC+  to  be  the  set  of  states  on  dC  which  can  only  be  kept 
on  dC  by  u  =  1  and  dC~  to  be  the  set  of  states  on  dC  which  can  only 
be  kept  on  dC  by  u  =  -1,  then  intuitively,  these  two  surfaces  are  not 
separable  with  a  plane.  With  a  similar  procedure,  the  negative  result 
in  this  note  can  be  extended  to  systems  with  complex  eigenvalues,  al¬ 
though  it  is  somewhat  harder  to  characterize  the  curve  that  separates 
dC+  and  dC~ . 


It  suffices  to  show  that  /(A)  is  an  increasing  function  of  A  for  A  >  Ai , 
or,  equivalently,  that 

e**2  _  i 

is  an  increasing  function  of  A  for  A  >  0.  Let  g( A)  — 

dfi/dX  (eAtl  -  l)2,  then 

g( A)  ={t2  -  f1)eA(t2+‘l)  -  <2eA‘2  +  fieA 
=eAtl((t2-f1)eAt2 


-f2eA(t2_tl)  +ti). 


Let 


ffi(A)  =  g( A)e“Atl  =  (h  -  <i)eA‘2  -  f2eA(*2_tl)  +  t,. 


Then 


Appendix 

Proof  of  Lemma  2.1 

For  simplicity,  we  assume  that  the  smallest  t*  is  <3  and  <3  iir  Notingfthat 
Otherwise,  we  can  multiply  (3)  from  left  with  e  At3 .  We  also  assume 
that  *2  >  ti  >  0. 

We  will  first  show  that 


=  ch  -  t,)t2  feA'2  -  eA{t2-'l))  >  0,  VA  >  0. 
dX  jMh  \  ' 

Since  it  follows  that  01(A)  >  0  and  hence  g( A)  >  0  for 


all  A  >  0|plrefore,  dfi /dX  >  0  for  all  A  >  0  and  hence  /i  (A)  is  an 
increasing  function  pTA*  It  follows  that  (14)  and  (11)  are  true. 

We|next  show<f|X  Suppose,  on  the  contrary,  that  there  exist 
‘1 ,  0)  such  ffiat  a 

. # 


M 


kieAtl  +  k2eM*  +  k3I  ?  0,  V(*i,  *2,  k3 )  # 

We  assume  that  A  has  three  distinct  eigenvalues  Ag^,  -o , 

Ai  <  A2  <  A3.  For  the  case  where  A  has  two  or  l^fee  identical|igen- 

^Lsimilamdeas. 


A3 ,  with^.< 


values,  we  can  prove  the  result  in  a  simpler  way  « ^*^"**“3^** — — - 

We  further  assume  that  A  =  diag[Ai,  A2,  XS/ Then (l^|  cam6e  reor- 

.  A  „ 

gamzed  as 

eAlti  e*1*2 

e^2*l  eA2*2 


Jgj?  kieAtl  +%26Aia  +  k3I  =  -fi  A* 

a, 

\  .  for  some  (71.^72;  73 )  I4  (0,0,0),  we 


[A2b 


+  72-4  +  73/ 

V.v 


□ 


This  is  equivalent  to 


direct  computation  shows  that 

=  (eA2tl  - 


*1*1 

eAl*5 

*2*1 

eA2‘2 

*3*1 

eA3‘2 

det 


We  claim  that 


-(■ 


>2*2  _  1*2 


)  (eA3*2  -  eAl‘2) 

)  (eA3<i  _  eAl‘l)  . 


0*3*2  _  0*1*2  0*2*2 


(>*3*1.  —  eAlti  e^2*i  —  eAltl 


(14) 


from  which  (13)  and  (11)  will  follow. 

We  now  proceed  to  prove  (14).  Define 

/(*):= 


0**2  _  0*1*2  eXltl  C(A“Al)*2  _  l 
e**i  —  *  eAita  e(A  “■**)*>■  —  1 


ich  contradicts  the  asstimpuoiLth$?(A^ 

«r  g  H 
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9  Abstract  ' 

We  give  simple  exact  descriptions  of  the  null  controllable  regions  for  general  linear  systems  with  saturating  actuators. 
11  The  description  is  in  terms  of  a  set  of  extremal  trajectories  of  the  anti-stable  subsystem.  For  lower  order  systems  or 
systems  with  only  real  eigenvalues,  this  description  is  further  simplified  to  fesult  in  explicit  formulae  for  the  boundaries 
13  of  the  null  controllable  regions.  ©  2002  Published  by  Elsevier  Science  B.V. 

Keywords:  I;  H;  ■ 


15  1.  Introduction  0"  ^ 

One  of  the  most  fundamental  issues  associated;  with  the  control  of  a  system  is  its  controllability.  Since  all 
17  practical  control  inputs  are  bounded  (due  to  actuator  saturation),  the  constrained  controllability  was  formulated 
earlier  than  the  unconstrained  one.  While  the  unconstrained  controllability  has  been  well  understood  for  several 
19  decades,  there  have  been  continual  efforts  towards  full  understanding  of  the  constrained  controllability  (see, 
e.g.,  [1-3,7,8,10,12,16-19]  and  the  references  therein). 

21  For  a  linear  system  with  a  coiistrained  input,  the  null  controllable  region  at  a  time  T  G  (0,  oo),  denoted  as 
<g(T),  is  defined  to  be  the  set  of  states  that  can  be  steered  to  the  origin  in  time  T  with  a  constrained  control. 
23  The  union  of  ^(T)  for  all  T €  (0,  oo),  denoted  as  <6,  is  called  the  null  controllable  region.  In  the  earlier  studies, 
the  null  controllable  region,  also  Called  the  controllable  set  or  the  reachable  set  (of  the  time  reversed  system), 
25  was  closely  related  to  the  time  optimal  control  (e.g.,  [2,7,11,13]):  for  a  given  initial  state  xo,  the  time  optimal 
control  problem  has  ai  solution  if  and  only  if  xq  G  If  xo  is  on  the  boundary  of  ’5^(7’),  then  the  minimal 
27  time  to  steer  x0  to  the  origin  is  T.  It  is  well-known  that  the  time  optimal  controls  are  bang-bang  controls. 

For  discrete-time  systems,  the  time  optimal  control  can  be  computed  through  linear  programming  and  '€{T) 
29  can  be  exactly  obtained,  although  the  computational  burden  increases  as  T  increases.  Also  closely  related  to 
the  time  optimal  control  is  the  model  predictive  control  or  the  receding  horizon  control.  The  model  predictive 
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1  control  has  been  extensively  studied  and  has  found  wide  applications  in  slow  processes  (see,  e.g.,  [14,15]  for 
a  survey).  The  development  of  the  model  predictive  control  also  contributes  to  the  characterization  of 
3  for  discrete-time  systems.  On  the  contrary,  for  continuous-time  systems,  since  the  time  optimal  control  is 
generally  impossible  to  compute  except  by  numerical  approximation,  there  has  been  no  result  on  the  explicit 
5  or  analytical  characterization  of  or  V  of  exponentially  unstable  systems.  There  are  however  numerical 

algorithms  available  to  obtain  approximations  of  #  based  on  some  partial  properties  about  the  boundaiy  of  # 
7  for  second-order  systems  (e.g.,  [18,19]).  There  are  also  numerical  methods  for  testing  if  a  particular  point  in 
the  state  space  is  inside  #  (e.g.,  [6]).  In  this  paper,  we  will  focus  on  the  analytic  characterization  of  #  for 
9  general  linear  systems. 

We  recall  that  a  linear  system  is  said  to  be  anti-stable  if  all  its  poles  are  in  the  open  right-half  plane  and 
11  semi-stable  if  all  its  poles  are  in  the  closed  left-half  plane.  %,#" 

For  a  semi-stable  linear  system,  it  is  well-known  [13,16,17]  that  the  null  controllable  region  is  the  whole 
13  state-space  as  long  as  the  system  is  controllable  in  the  usual  linear  system  sense.  For  a  general  system  with 
exponentially  unstable  modes,  there  exists  a  nice  decomposition  result  concerning  die  null  controllable  region 
15  [5],  Suppose  such  a  system  is  decomposed  into  the  sum  of  a  controllable  semi-stable  subsystem  and  an 

anti-stable  subsystem,  then  the  null  controllable  region  of  the  whole  system  is  the  Cartesian  product  of  the 
17  null  controllable  region  of  the  first  subsystem,  which  is  its  whole  state  space,  and  that  of  the  second  subsystem, 
which  is  a  bounded  convex  open  set.  _  .... 

19  However,  little  was  known  about  the  null  controllable  region  of  an  anti-stable  system.  This  paper  is  dedicated 
to  solving  this  problem.  We  will  give  simple  exact  descriptions  of  the  null  controllable  region  of  a  general 

21  anti-stable  linear  system  with  saturating  actuators  in  terms  of  a  set  of  extremal  trajectories  of  its  time  reversed 

system.  This  set  of  extremal  trajectories  is  particularly  easy  to  describe  for  low  order  systems  or  systems  with 
23  only  real  eigenvalues.  For  example,  for  a  second-order  system,  the  boundary  of  its  null  controllable  region  is 
covered  by  at  most  two  extremal  trajectories;  and  for  a  third-order  system,  the  set  of  extremal  trajectories  can 

25  be  described  in  terms  of  parameters  in  a  real  interval.  Jf' 

The  remainder  of  the  paper  is  organized  as  follows.  {Section  2  contains  some  preliminaries  and  definitions 

27  of  notation.  Section  3  gives  a  simple  exact  description  of  the  null  controllable  regions  of  anti-stable  linear 

systems  with  bounded  controls.  Section  4  draws  a  brief  conclusion  to  this  paper. 


29  2.  Preliminaries  and  notation 

Consider  a  linear  system  *  i  :'  ;y  , 

X(t)  =  Ax(t)  +  Bu(t),  7 

31  where  x(t)  €  R"  is  the  state  and  u(t)  €  Rm  is  the  control.  Let 

%a  =  {u:  u is  measurable  and  ||n(OI|oo  ^  1>  V(  €  R},  (2) 

where  ||m(0Ho6  =  max/  |«i(OI-  A  control  signal  u  is  said  to  be  admissible  if  u  e45ffl.  In  this  paper,  we  are 
33  interested  in  the  control  of  system  (1)  by  using  admissible  controls.  Our  concern  is  the  set  of  states  that  can 
be  steered  to  the  origin  by  admissible  controls. 

35  Definition  2.1.  A  state  x0  is  said  to  be  null  controllable  if  there  exist  a  f  €[0,oo)  and  an  admissible  control  u 
such  that  the  state  trajectory  x(t)  of  the  system  satisfies  x(0)=x0  and  x(T)— 0.  The  set  of  all  null  controllable 
37  states  is  called  the  null  controllable  region  of  the  system  and  is  denoted  by  #. 
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1  With  the  above  definition,  we  see  that  x0e%  if  and  only  if  there  exist  T e  [0, oo)  and  a«e4a  such  that 

rT  /  rT  \ 

0=x(7’)  =  eATxo  +  '  eA^T~x)Bu(x)dr  =  di7  1  x 0+  '  e  AxBu{x)dx  . 

X  '  A 


It  follows  that 

I 


rs[0,oo) 


=  -  I  t~AxBu(x) dx 

0 


3  The  minus  sign  before  the  integral  can  be  removed  since  is  a  symmetric  set.  In  what  follows  we 
recall  from  the  literature  some  existing  results  on  the  characterization  of  the  null  controllable  region. 

5  Proposition  2.1.  Assume  that  ( A,B )  is  controllable. 

(a)  If  A  is  semi-stable,  then  <4  =  R".  .  ||  ^ 

7  (b)  If  A  is  anti-stable,  then  <4  is  a  bounded,  convex  open  set  containing  the  origin.  ;  %.  Jf 

(c)  Ij  j$'*Vr%W>  ’ 

°1  •  .  %,J 

°  a*  $ 

9  with  A\  €  R"1  anti-stable  and  A2  6  R'l2X'12  semi-stable,  and  B  is  partitioned  as 

r*.i  * 

Bi  ^  "% 

accordingly,  then  <4  =  (4\  x  R"2  where  <4\  is  the  null  controllable  region  of  the  anti-stable  system 
11  Xi(t)  =  A\X\  +  B\u(t).  Jy 

Statement  (a)  is  well-known  [13,16,17].  Statements  (b)  and  (c)  are  proven  in  [5],  Because  of  this  propo- 
13  sition,  we  can  concentrate  on  the  study  of  null  controllable  regions  of  anti-stable  systems.  For  this  kind  of 
systems, 

<£=^x=  ^  cTAxBu(t)dx:  ,  ?*:r  %  ^ 

o  ^ 

15  where  <4  denotes  the  closure  of  V.  We  will  use  “3”  to  denote  the  boundary  of  a  set.  In  [6],  a  nonlinear 
programming  based  algorithm  is  proposed  to  test  if  a  point  in  the  state  space  belongs  to  <4.  In  Section  3,  we 
17  will  derive  a  method  for  explicitly  describing  dtf.  To  this  end,  we  will  need  some  more  preliminaries. 

If  B  =  [b\, b2, . . ■, bm]  and  the  mill  controllable  region  of  the  system  x(t)=Ax(t)  +  bjU,{t)  is  <4b  i  =  l,...,m, 

19  then 


m  ?'/:  " ;■  --V 

<e  =  '^r<4i-{x\  +xi:ir'--'$rxm:xi€<4i,  i-  1,2,. 


In  view  of  (5)  and  Proposition  2.1,  in  the  study  of  the  null  controllable  regions  we  will  assume,  without  loss 
21  of  generality,  that  (^,B)  is  controllable,  A  is  anti-stable,  and  m  =  1.  For  clarity,  we  rename  B  as  b. 

For  a  general  system 

x  =  /(x,u),  ^ 

23  its  time  reversed  system  is 

i  =  -/(z,n).  (7) 

It  is  easy  to  see  that  x(t)  solves  (6)  with  x(0)=x0,x(t1)  =  xi,  and  certain  u  if  and  only  if  z(t)  =x(h  -  t ) 
25  solves  (7)  with  z(0)  = x,  ,  z{tx  )=x0,  and  v(t)  =  u(h  - 1).  The  two  systems  have  the  same  curves  as  trajectones, 
but  traverse  in  opposite  directions. 
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Consider  the  time  reversed  system  of  (1): 

i(f)  =  - Az(t )  —  bv(t).  (8) 


Definition  2.2.  A  state  zf  is  said  to  be  reachable  if  there  exist  T  €  [0,  oo)  and  an  admissible  control  v  such 
that  the  state  trajectory  z(t)  of  system  (8)  satisfies  z(0)  =  0  and  z(T )  =  zf.  The  set  of  all  reachable  states  is 
called  the  reachable  region  of  system  (8)  and  is  denoted  by  01. 


It  is  known  that  <<?  of  (1)  is  the  same  as  31  of  (8)  (see,  e.g.,  [13]).  To  avoid  confusion,  we  will  continue 
to  use  the  notation  x,  u  and  for  the  original  system  (1),  and  z,  v  and  01  for  the  time-reversed  system  (8). 


3.  Null  controllable  regions 

In  Section  3.1,  we  show  that  the  boundary  of  the  null  controllable  region  of  a  general  anti-stable  linear 
system  with  saturating  actuator  is  composed  of  a  set  of  extremal  trajectories  of  the  time  reversed  system.  The 
descriptions  of  this  set  are  further  simplified  for  systems  with  only  real  poles  and  for  systems  with  complex 
poles  in  Sections  3.2  and  3.3,  respectively. 

3.1.  Description  of  the  null  controllable  regions  %  #  ' 

We  will  characterize  the  null  controllable  region  #  of  system  (1)  'through  studying  the  reachable  region  01 
of  its  time  reversed  system  (8).  a,  J? 

Since  A  is  anti-stable,  we  have  jF 


f  f°° 

01  =  1  z  =  '  e~Arbv( t)  dr:  v  € 1 

o 


v  r 


=  '  z—  ‘  eAxbv(i)  dr:  v€‘ 


1 


The  change  of  integration  interval  from  [0,  oo]  to’t  -  oo,  0]  is  crucial  to  our  development,  as  will  be  clear 
from  Eq.  (17).  Noticing  that  e^  =  e-y4(0-T),  we  see  that  a  point  z  in  01  is  a  state  of  the  time-reversed  system 
(8)  at  t  =■  0  by  applying  an  admissible  control  n  from  —  oo  to  0. 


Theorem  3.1.  'tg... 

(  r°  1 

dSi  -  z  —  eAzb  sgn(c'eATb)  dr:  cfO  . 

—  OO 


(9) 


is  strictly  convex.  Moreover,  for  bach  z*  e  80,  there  exists  a  unique  admissible  control  v*  such  that 

rO  >  v;!,V  iff 

z*=  eArbv*(t)  dr.  0®) 


Remark  3.1.;  We  give  some  simple  facts  about  convex  sets  in  this  remark.  Consider  a  closed  set  S.  If  S  is 
convex  and  z*-€  d'S,  then  by  separation  theorem,  there  exists  a  hyperplane  c'z  =  k  that  is  tangential  to  dS  at 
z*  and  the  set  S  lies  completely  to  one  side  of  the  hyperplane,  i.e., 

c'z  ^k  =  c'z* ,  Vz  €  S. 


A  set  S  is  said  to  be  strictly  convex  if  it  is  convex  and  for  any  two  points  zi,z2  €  8S,  cez{  +  (1  -  a)z2  £  SS  for 
all  a  €  (0, 1).  This  is  equivalent  to  saying  that  any  hyperplane  that  is  tangential  to  dS  has  only  one  intersection 
point  with  dS,  or,  for  any  cf  0,  there  exists  a  unique  z*  €  dS  such  that  c'z*  =  maxz€5  c'z. 
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I  Proof  of  Theorem  1.  First,  the  convexity  of  ^2  can  easily  be  verified  by  definition.  Let  z*  €  dSl.  Then,  there 
exists  a  nonzero  vector  c  G  R"  such  that 

c'z*  =  max  c'z  =  max  ^  c'eAxbv(x)  dt.  (n) 

z€#  -oo 

3  Since  c^O  and  (A,b)  is  controllable,  c'^b  £  0.  Since  c'et'b  has  a  finite  number  of  zeros  in  any  finite 
interval, 

H({t:c'eA'b  =  0})  =  0,  (12) 

5  where  /x(-)  denotes  the  measure  of  a  set. 

It  is  easy  to  see  that  Xt 

v*(t)  =  sgn (c'e.A‘b)  £  % 

7  maximizes  the  right-hand  side  of  ( 1 1 ).  We  maintain  that  v*  is  the  unique  optimal  solution  of  (11 ).  To  verify 
this,  we  need  to  show  that  for  any  v  €  v  ^  v  ,  % 

f  t)dt>  ^  c'eAxbv(x)dx.  J  J  ''  03) 

-oo  -oo  ^  '"v'  -'' 

9  Since  o  /  »*,  there  are  a  set  £,  C  [  -  oo,  0]  with  nonzero  measure,  i.e.,  /t(Ff)=M,  %0,  and  a  number  s,  >  0 
such  that 

WO  -  ®*(0I  >  *j»  Vre£>- 

II  By  (12),  there  exist  a  set  E  C  £,,  with  /t(F)  =  5  >  0,  and  a  positive  number  e  >  0  such  that 

Ic'e^l  >  e,  Vt€E.  , 

Noting  that  v€<&a,  we  have  .#) 

c'eA‘b(v\t)-v(t))>0,  Vf  G  [  —  oo,0],  g®  % 

13  It  then  follows  that 


fo 


c'eAxb(v\x)  -  o(t))dt 


c'zAxb(v*(x)  -  a(0)dx-  '  |cVTh|  |u*(t)  -  t>(t)|  dt  >  <5ee,  >  0. 


>  I"  c'eArb<lv*(x)  -  a(0)dt-  ^  |c'e 
This  shows  that  u*(0  is  the  unique  Optimal  solution  of  (11)  and  hence  the  unique  admissible  control  satisfying 

r° 


eAxbv*(x)  dt. 


(14) 


15  On  the  other  hand,  if 


z*  =  (  :eAxbsgn(c'<iAxb)dx 

-OO 

for  some  nonzero  c,  then  obviously 


•c'z*  =  max  c'z. 


17  This  shows  that  z*  e  d0t  and  we  have  (9).  ‘ 

Since  for  each  c±  0,  the  optimal  solution  v*(t)  and  z*  of  (11)  is  unique,  we  see  that  01  is  stnctly  convey 


19 
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1  Theorem  3.1  says  that  for  z*  €  dSi,  there  is  a  unique  admissible  control  v*  satisfying  (10).  From  (9),  this 
implies  v*(t)  =  sgn(c'eAlb)  for  some  c#  0  (such  c,  ||c||  =  1  may  be  nonunique,  where  ||  •  ||  is  the  Euclidean 

3  norm).  So,  if  v  is  an  admissible  control  and  there  is  no  c  such  that  v(t)  =  sgn(c'eA‘b)  for  t  ^  0,  then 

,° 

1  eAxbv(t)  dr  ^  801 

—  OO 

and  must  be  in  the  interior  of  Si. 

5  Since  sgn()fcc'e/4Th)=sgn(cVtfc)  for  any  positive  number  k,  Eq.  (9)  shows  that  8Si  can  be  determined  from 
the  surface  of  a  unit  ball  in  R".  In  what  follows,  we  will  simplify  (9)  and  describe  80  in  terms  of  a  set  of 

7  trajectories  of  the  time-reversed  system  (8).  Jj 

Denote 

£:={v(t)  =  sgn(cV'h),  t  €  R  :  c  ^  0}  (15) 

9  and  for  an  admissible  control  v,  denote 

<P(t,v):=  ?  t-A(t-x)bv{x) dr.  _  f,  O6) 

—  OO  ,:-0  'V  /' 

Since  A  is  anti-stable,  the  integral  in  (16)  exists  for  all  reR,  so  $(t,  v)  is  well  defined. ... 

11  If  v(t)  =  sgn(c'e^'h),  then 

4>(t,v)=  1“  e~A^~^bv(r)  dr=  ^  e/4T6sgn(cV'e/,T6)dt  e  80  'V_.._  (17) 

-oo  —oo  ' 

for  any  t  e  R,  i.e.,  <P(t,  v)  lies  entirely  on  80.  An  admissible  control  v  such  that  lies  entirely  on  80  is 

13  said  to  be  extremal  and  such  <P(t,  v)  an  extremal  trajectory.  On  the  other  hand,  given  an  admissible  control 

v{t),  if  there  exists  no  c  such  that  v{t)  =  sgn (cWb)  for  all  t  ,<  0,  then  by  Theorem  3.1,  0(0;  v)  $  80  and 
15  must  be  in  the  interior  of  SI.  By  the  time  invariance  property  of  the  system,  if  there  exists  no  c  such  that 

v(t)  =  sgn(cV'h)  for  all  t  <  t0,  <P(t,  v)  must  be  in  the  interior  of  0  for  all  t  >  t0.  Consequently,  £  is  the  set 

17  of  extremal  controls.  * 

The  following  lemma  shows  that  8  Si  is  covered  by  the:  set  of  extremal  trajectories. 

19  Lemma  3.1. 

80  =  {<?(r,r):  1 6  R,  v  €  £}.  (18) 

21  Proof.  For  any  fixed  /  e  R,  it  follows  from  (9)  that 

80=^  ?  e~A(,~x)b  sgn(c,e~A‘eAxb)  dr:  c  ^  0^  =  ^  ^  e-y4('-t)hsgn(cVTh)dr:  c^o'*  , 

— °°  ,  _  -°° 

i.e.,  80={<P(t,v):  n€<f},  for  any  fixed  t€  R.  So  80  can  be  viewed  as  the  set  of  extremal  trajectories  at  any 
23  frozen  time.  Now  let  (  vary,  then  each  point  on  dSt  moves  along  a  trajectory  but  the  whole  set  is  invariant. 

So  we  can  also  write  Si22  =  {<P(t,  v):  v  €  £,  1 6  R},  which  is  equivalent  to  (18).  □ 

25  Unlike  (9X  Eq.  C(18)  shows  that  80  is  covered  by  extremal  trajectories.  It,  however,  introduces  redun¬ 
dancy  by  repeating  the  same  set  {#(/,»):  ve£j  for  all  t£ R.  This  redundancy  can  be  removed  by  a  careful 
27  examination  of  the  set  S.  Indeed,  the  set  {<P{t,  v):  t  e  R}  can  be  identical  for  a  class  of  v  €  £. 

Definition  3.1.  . 

29  (a)  Two  extremal  controls  vhv2€£  are  said  to  be  equivalent,  denoted  by  v,  ~  v2,  if  there  exists  an  he R 

such  that  vi(t)  =  v2(t  —  h)  for  all  t  €  R. 
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1  (b)  Two  vectors  cuc2  €  Rn  are  said  to  be  equivalent,  denoted  by  Cj  ~  c2,  if  there  exist  a  k  >  0  and  an  h  G  R 

such  that  c\  =  kz?'hC2- 

3  Noting  that  a  shift  in  time  of  the  control  corresponds  to  the  same  shift  of  the  state  trajectory,  we  see  that, 
if  Vi  ~  v2>  then  {<£(/,  rO:  te  R}  =  { <P(t,v2 ):  te  R};  and  if  cx  ~  c2,  then  sgn(c;^Z?)  -  sgn(c'e^rZ?). 

5  Definition  3.2. 

(a)  A  set  <?min  c  £  is  called  a  minimal  representative  of  £  if  for  any  ve£,  there  exists  a  unique  Pj  G  £m\n 
7  such  that  v  ~  v\. 

(b)  A  set  M  C  R”  is  called  a  minimal  representative  of  R”  if  for  any  cgR",  there  exists  a  unique  cx  eM 

9  such  that  c  ~  C\.  %■ 

With  this  definition,  there  will  be  no  pair  of  distinct  elements  in  £m[n  or  in  M  that  are  equivalent^  should 
11  be  noted  that  the  minimal  representative  of  £  or  W  is  unique  up  to  equivalence  and  <?min.and  M  always 
exist.  An  immediate  consequence  of  these  definitions  and  Lemma  3.1  is 

13  Theorem  3.2.  If  £^  is  a  minimal  representative  oj  £y  then  , 

dSl  =  v)m.  t  G  R,  V  C  £  min}  \  ^  v 

If  M  is  a  minimal  representative  oj  R”,  then  ^ 

dM  =  sgn(c'e^b)):  t  G  R,  c  G  M\{0}}. 

^  Ji" 

15  It  turns  out  that  for  some  classes  of  systems,  <?min  can  be  easily  described.  For  second  order  systems,  <?mj„ 
contains  only  one  or  two  elements,  so  d0t  can  be  covered  by  no  more  than  two  trajectories;  and  for  third-order 
17  systems,  <fmm  corresponds  to  some  real  intervals.  We  will  see  later  that  for  systems  of  different  eigenvalue 
structures,  the  descriptions  of  <?mjn  can  be  quite  different. 

,/S- 

19  3.2.  Systems  with  only  real  eigenvalues  ^ 

It  follows  from,  for  example,  [13,  p.  77],  that  if  A  has  only  real  eigenvalues  and  c^O,  then  cWb  has  at 
21  most  n  —  1  zeros.  This  implies  that  an  extremal  control  can  have  at  most  n—  1  switches.  We  will  show  that 
the  converse  is  also  true.  4?'  %  % 

23  Theorem  3.3.  For  system  (8),  assume  that  A  has  only  real  eigenvalues,  then 
(a)  an  extremal  control  has  at  most  n  -  1  switches’, 

25  (b)  any  bang-bang  control  with  n  -  1  or  less  switches  is  an  extremal  control. 


Proof.  See  Appendix  A,  □ 


27 


)  29 


By  Theorem  3.3,  the  set  of  extremal  controls  can  be  described  as  follows: 


f 

fl 

— OO^t<ti,  I 

l±v: v(t)  =  < 

(- 

■iy 

ti^t  <  ti+ 1,  -  oo  <  ti  <  t2  <  •  •  •  ^  4,-1  <  CO  | 

l  1 

(- 

t„-l  <  t  <  oo,  J 

where  i  =  l,...,n  —  1,  are  the  switching  times.  If  v(t)  has  a  switch,  then  the  first  switch  occurs  at  t  — 1\. 
Here  we  allow  U=ti+\  (i  yH )  and  tn-\  =  oo,  so  the  above  description  of  S  consists  of  all  hang-bang  controls 
with  n  -  1  or  less  switches. 
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1  To  obtain  a  minimal  representative  of  <?,  we  can  simply  set  t\  =  0,  that  is, 

f  [  1,  -oo<t<tu  1 

^min  =  t  ±v:  v(t )  =  '  (-1)'',  ti^t<ti+u  0  =  <i  <  h  •  •  •  <  t„- 1  <  oo  \  U  {o(/)  =  ±1}. 

(  ((-l)"-1,  t„-i^t<oo.  ) 

For  every  v  e  <?m;n,  we  have  v(t)  —  1  (or  —1)  for  all  t  <  0.  Hence,  for  t  <  0, 

<P(t,v)=  ^  e~A(0~z)b dt  =  A~1b  (or  -  A~'b ). 

-OO 

3  Afterwards,  v(t)  is  a  bang-bang  control  with  n- 2  or  less  switches.  Denote  ze+  =  -A~lb  and  z~  =A~lb,  then 
from  Theorem  3.2  we  have, 

5  Observation  3.1.  dSt-dV  is  covered  by  two  bunches  of  trajectories.  The  first  bunch  consists  fif  jffijeqjories 
oj  (8)  whose  initial  state  is  z*  and  the  input  is  a  bang-bang  control  that  starts  at  t  =  0  wtih  -j^and  has 
7  n  —  2  or  less  switches.  The  second  bunch  consists  of  the  trajectories  oj  (8)  whose  initial  state  is  ze  and  the 
input  is  a  bang-bang  control  that  starts  at  t  =  0  with  1  and  has  n  —  2  or  less  switches. 

9  Furthermore,  can  be  simply  described  in  terms  of  the  open-loop  transition  matrix.  Note  that  for  a  fixed 
t  >  0, 


{<* >(f,»): 

=  ^  Ie""z+ 


r  1  pti+i  *1  j 

.  /  e-^(l-T)^(_i)/  dt  ;  0  =  f,  <  /2  <  tn-l  <  t„  =  t  U  {±zj} 


f  fn-l  ]  €.  ,#  ■ .  ) 

=  1  ±  sr2(-l)ie-A'-,l)  +  (—!)”/  A~lb:  0  =  ff  <%<£?.  ^  r„_,  <  t  U  {±z+>. 


11  Hence, 


SM  —  n)*  t  6  R,  U  min} 


f  T”-1  41/ 1 

1  ±  VK-l/e-^'"1  +  (^ly/  ^6:  0  =  fi 


Here,  we  allow  tt  =  t2  to  include  ±z+.  For  second-order  systems, 

30  =  l"e-^z7  -  /W(,"TVd^  :  te[0,oo]^  =  {±{-2eTAt  +  I)A~'b:  t€[0,oo]}.  (19) 

:|-o  ^ 

13  Plotted  in  Fig.  1  is  the  dSf  of  a  second-order  system  with 

To  -o.4  i  [  o  1 

•”  1  ' 

We  see  that  <5^2  Consists  of  a  trajectory  from  z+  to  z~  under  the  constant  control  v  =  -1  and  a  trajectory 
15  from  z~  to  z+  under  the  constant  control  v=  1. 

If  „  =  3 ;  then  one  half  of  dSt  =  df€  can  be  formed  by  the  trajectories  of  (8)  starting  from  ze  with  the 
17  control  initially  being  -1  and  then  switching  at  any  time  to  1.  So  the  trajectories  go  toward  ze  at  first  then 
turn  back  toward  zf.  The  other  half  is  just  symmetric  to  the  first  half.  That  is 

30  =  f  ±  r e~*z+  +  P  t~A^bdx  -  ?  d ^  :  0  <  h  t  «£  oo'1  . 


19 


0 


(20) 
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Fig.  2.  of  a  third-order  system. 


1  Plotted  in  Fig.  2  is  the  831  of  a  third-order  system  with 


'0.2 

1 

0  ' 

T 

A  = 

0 

0.2 

of 

,  5  =  ' 

i 

0 

0  , 

:0.4_ 

i 

Since  the  trajectories  of  the  original  system  and  those  of  the  time-reversed  system  are  the  same  but  traverse 
3  in  opposite  directions,  we  can  also  say  that  831=8%  is  covered  by  a  set  of  trajectories  of  the  original  system. 

While  all  the  trajectories  of  the  time-reversed  system  start  at  zf  or  ze  and  are  very  easy  to  generate  by 
5  simulation,  it  is  impossible  to  obtain  the  same  trajectories  from  the  original  system.  For  example,  when  n  = 2, 

one  half  of  5#  is  formed  by  the  trajectory  of  the  time-reversed  system  that  starts  at  ze  under  a  constant 
7  control  n=Wfhc  trajectory  goes  from  z~  toward  z+  asymptotically  but  never  reaches  z+  at  a  finite  time. 

It  seems  that  if  we  apply  u  =  + 1  at  z+  to  the  original  system,  the  trajectory  will  go  from  z+  to  ze  along 
9  the  same  trajectory  of  the  time-reversed  system.  However,  this  is  not  the  case.  The  trajectory  of  the  original 

system  will  stay  at  zf  under  the  constant  control  u  —  4-1.  The  boundary  dffi  can  only  be  partially  generated 
11  from  the  original  system  if  we  know  one  point  on  it  other  than  ±z+ .  But  this  point  is  not  easy  to  determine. 
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1  33.  Systems  with  complex  eigenvalues 

For  a  system  with  complex  eigenvalues,  the  minimal  representative  set  £ min  is  harder  to  determine.  In  what 
3  follows,  we  consider  two  important  cases. 

Case  1.  Ae  R2x2  has  a  pair  of  complex  eigenvalues  a  ±  j/i,  a,  /?  >  0. 

5  In  order  to  arrive  at  an  explicit  formula  for  we  need  to  simplify  cV'Z?.  To  this  end,  let  V  be  the 
nonsingular  matrix  such  that 


A  =  V  T“  ^  v~l 
P  * 


7  and  let 


^c^=V'c,  =V~lb, 

c2  b2 


c'eA,b  =  [ci  c2]  • 


[cos (Pt)  -sin(/?0l  [ &i  1 


'*■  1  2J  sin(/?0  cos(j 8t)  b2 

:[COS(/fc) 


9  Since 


r  bi  b2 1  % 

hi  b\  J?v  f 

is  nonsingular,  it  follows  that 

f  I"  b)  bf  c^(C  =  K  ^SiD(r?J  :  #0,e€[b,2n)^  . 

— 62  h\  ^2  COS yo)  i,,,  A 


11  Hence 

(sgn(c,e/*,i)):  c^O}  =  {sgn(sin(/?/  -b  6)):  0  €  [O,27i)}, 
and  the  set  of  extremal  controls  is  .....  "v  : 

<?  =  {n(t)  =  sgn(sin(/h  +  d)),  t  €  R  :  6  €  [0, 2%)}. 

13  It  is  easy  to  see  that  V 

<£„.»  =  MO  =  sgn(sin(/Jt )),  i  6  R} 

contains  only  one  element.  Denote  Tp  =  it/P,  then  e  A7p  =  — e  a7pI .  Let 


z~  =  (/  +:e-^)->(/  _  t~ATp)A~lb  = 


1  +  e~a~p  __ 
1  -c~aTpZe 


15  It  can  be  verified  that  the  extremal  trajectory  corresponding  to  n(/)  =  sgn(sin(/?/))  is  periodic  with  period  2TP 
and, 


■  -  J‘e-A«-%d%  :te[0,7»} 


=  {±[e~A,z~  -(I-  e~M)A-'b]:  t  €  [0,  Tp)}. 


17 
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1  Case  2:  A  e  R3*3  has  eigenvalues  a  ±  jP  and  ah  with  a,  P,  ai  >  0.  (a)  a  =  oti .  Then  similar  to  Case  1, 

8  =  {n(r )  =  sgn(&  +  sin  (fit  +  0)),  t  £  R  :  k  £  R,  0  £  [0, 27t)}. 

Since  sgn (k  +  sin (pt  +  0 ))  is  the  same  for  all  k  ^  1  (or  k  <  -  1),  we  have 
8mia  =  {t<0  =  sgn(fc  +  sin(^)),  <  6  R  :  k  €  [  -  1, 1]}- 

3  Each  v  €  min  is  periodic  with  period  2TP,  but  the  lengths  of  positive  and  negative  parts  vary  with  k. 

can  be  easily  determined  from  simulation. 

5  (b)  cc\  7^  a.  Then 

g  =  {v(t)  =  sgn(hei*'-a)‘  +  k2Mpt  +  e)),te'R  :  (*i,fe)#(O,O),0€[O,2*)}. 

&  can  be  decomposed  as  8  —  8 1 l)  82U  83,  where  ®  % 

Si^{v(t)  =  ±l}  (fe  =  0). 

82  =  {i>(0  =  ±sgn(sin(/fr  4-  0)):  0  €  [0, 2n)}  (h  =  0), 

<f3  =  {n(t)  =  ±sgn(ie(<I1-a^  +  sin(/h  +  0)):  k  >  0,9  €  [0,27t)}.  ^ 

7  We  will  show  that  a  minimal  representative  of  83  is 

82  min  =  MO  =  ±sgn(e(ai~“t)'  +  sin (pt  +  0)):  0  £  [0,27i)}.  ^  ^ 

Let  4 '  j£?  yc 

v(t)  =  sgn(jfce(“' -tt)'  +  sin(/?t  4-  0))  €  83.  s.:  ^ 

9  Since  k  >  0,  there  is  a  number  h  €  R  such  that  e(ai.  =  A-  So 
„(()  =  sgn(e(ai-*)(<+*)  4-  sin (P(t  +  h)  -  ph  +  0))  = OO  +  A) 
for  some  p,(|) €  <?3  min-  On  the  other  hand,  given  Vi,v2  €  <?3  min,  suppose 
Dj(/)  =  sgn(e(*'~a'r  4-  sin(Pt  +  0i)) 
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t?2(l)  =  sgn(e(a,_“)<  +  sin(jJt  +  02)) 
nd  »,  ~  i)2,  i-e-,  m(0  =  -  for  some  h,  then 

sgn(e(a,-a)<  +  sin(jSt  4-0i))  =  sgn(e<a| 4-  sin (p(t  -h)  +  02))- 
r  ^  r,  ~>  ri I-  both  e(a,_a)'  and  e(“1-“)(,_A)  go  to  zero  as  t  goes  to  00  (or  —00).  For  Vi(t)  and 

1(7- h)  to  chan#  s|lS  St  the  same  time,  we  must  have  pt  +  d ,  =  P(t  -  A)  +  fc  +  In  for  some  integer  l 
;jnce  at  any  switchinftime  of  M0  and  u2(0,  sin  {fit  +  0i)  <  0,  sin  (p(t  -  h)  +  d2)<  0,  we  condude  that 
fotft  +  0,)y=  sin(j?(t  -h)  +  92)  and  e<“>-“>'  =  So  we  get  h  =  0,6i  =  d2.  These  shows  that  83  min 

s  a  minimal  representative  of  83.  „  tW 

The  minimal  representative  of  82  is  die  same  as  8min  in  Case  1.  It  follows  that 


8m\n  =  M0  =  ±1}  u  {»(/)  =  sgn(sin(^))}  U  83  min- 

If  «,  <  a,  for  each  t>  £  83  min,  b(0  =  Kor  “0  for  a11  1  ^  °>  so 
z+  _  _^-i£  or  ze"  before  /  =  0.  And  after  some  time,  they  go 


the  corresponding  extremal  trajectories  stay  at 
toward  the  periodic  trajectory  since  as  t  goes 
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Fig.  3.  Extremal  trajectories  on  5^,  ai  <  a. 


1  to  infinity,  v(t)  becomes  periodic;  When  ai  >  a,  for  each  vG&j  min,  v(t)  =  l(or  —  l)|for  all  t  ^  0,  and  the 
corresponding  extremal  trajectories  start  from  near  periodic  and  go  toward  z*  or  zj“.’  '  .  ' 

3  Plotted  in  Fig.  3  are  some  extremal  trajectories  on  d3%  of  the  time-reversed  system  (8)  with 
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which  has  two  complex  poles.  Jf 

5  For  higher  order  systems,  the  relative  location  of  the  eigenvalues  are  more  diversified  and  the  analysis  will 
be  technically  much  more  involved.  It  can,  however,  be:  expected  that  in  the  general  case,  the  number  of 
7  parameters  used  to  describe  is  n  —  2.  %  . 


4.  Conclusions 

9  We  gave  a  clear  understanding  of  the  mill  controllable  regions  of  general  linear  systems  with  saturating 
actuators.  We  showed  that  the  boundary  of  the  null  controllable  region  of  an  anti-stable  linear  system  is 
11  composed  of  a  set  of  extremal  trajectories  of  its  time-reversed  system.  The  description  of  the  boundary  of 
the  null  controllable  region  is  .further  simplified  for  lower-order  systems  and  systems  that  have  only  real 
13  eigenvalues.  |  %, 

5.  Uncited  references 

15  [4,9]  ^  %■'%/' 

Appendix  A.  Proof  of  Theorem  3.3 

First  we  present  a  lemma.  Let  us  use  ^  to  denote  the  set  of  real  polynomials  with  degree  less  than  integer 
k.  The  number  0  is  considered  a  polynomial  with  arbitraiy  degree  or  with  degree  —1. 


17 


13 
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1  Lemma  A.l.  Given  N  positive  integers,  k\  define  a  set  of  functions 

f  "  1 

9»:=  g(t)  =  T  ea'7.(0:  ft  €  a>  €  R,  gif )  f  0  . 

i—1 

Then  g{t)  €  has  at  most  X^=i  k  ~  1  zeros. 

3  Proof.  We  prove  this  lemma  by  induction.  It  is  easy  to  see  that  the  statement  is  true  when  N  =  1.  Now 
assume  that  it  is  true  when  N  is  replaced  by  AT  —  1.  Let  g(t')£  Suppose  on  the  contrary  that  g  has  kj 
or  more  zeros.  Then  g{t)  =  g(t)e~a"'  also  has  kt  or  more  zeros.  Therefore,  the  Mh  derivative  of  g, 

5 

rv-i  1  rv-i  ]  (i")  -S  : 

mfN)= Te^^o+M)  =  w €^-,, 

i=i  i-=i  #  '% 

has  at  least  7^7 1  zeros>  which  is  a  contradiction.  □  ,4® 

7  Proof  of  Theorem  3.3.  .  The  proof  of  (a)  was  sketched  in  [13,  p.  77],  where  an  additional  assumption  of 

normality  was  required.  This  assumption  is  satisfied  for  system  (8)  since  it’ is  single  input  and  (A,  b)  is 
9  controllable.  To  show  (b),  assume  that  A  has  N  distinct  real  eigenvalues  %i  =  1,2,..., N,  each  with  a 
multiplicity  of  k  (£*, k  =  n).  It  is  well-known  that  cfef,b=Y^0^^Mf)  for  some  //€£%.  Ifc^O,  then 
11  c'ef'b  ^  0  by  the  controllability  of  (A,b).  (Thus  (a)  follows  from  Lemhia  A.1).  To  complete  the  proof  of 
(b),  we  first  show  that  any  bang-bang  control  v  with  n  —  1  switches  is  an  extremal  control. 

13  Let  ti,  ^2, . . . ,  tn— i  €  R  be  distinct  switching  times  of  v.  From  the  following  n  —  1  linear  equations 

c'eAub  =  0,  i  =  1,2,...,»  -  1  J,??  '% 

at  least  one  nonzero  vector  ceR”  can  be  solved.  With  any  such  c,  (a)  implies  g(t)  =  c'eA‘b  fi  0  has  no  other 
15  zeros  than  the  n  —  1  zeros  at  U,i—  1,2,. . . ,  n  — 1‘.  . 

Now  the  question  is  whether  g(t)  indeed  changes  signs  at  each  If  it  does,  then  v(t)  =  sgn(cV'b)  (or 
17  sgn(-cV'b))  and  v  is  an  extremal  control: 

We  now  show  that  g  does  change  sighs  at  each  t{.  If  g  does  not  change  sign  at  a  certain  t,-,  then  git)  must 
19  have  a  local  extremum  at  t,,  so  g(tj )  —  0.  We  argue  that  there  is  at  most  one  tj  such  that  g(ti)  —  0,  otherwise 

g  win  have  at  least  n  zeros,  counting  the  at  least  n-  2  ones  lying  within  the  intervals  (/,-,/,•+ 1),  which  is 
21  impossible  by  Lemma  A.1  /since  g  has  the  same  structure  as  g. 

We  further  conclude  that  0,  however,  cannot  have  a  local  extremum  at  any  of  these  tf  s. 

23  Let  0(0  =  e^f‘i(0.  Assume  without  loss  of  generality  that  />(/)  #  0.  Suppose  on  the  contrary  that 

0  has  a  local  minimum  (or  maximum )  at  t\,  then  g[t)  =  g{t)eT^Nt  also  has  a  local  minimum  (or  maximum) 
25  at  furthermore,  ^}^O,0(//)^O,f  =  2,3 ,...,n  -  1.  Hence,  there  exists  an  e  >  0  (or  e  <  0)  such  that 

g(t)  -  £  =  e(Ai-i,,)7i(0  +  /v(0  -  e  has  n  zeros,  which  contradicts  with  Lemma  A.l.  Therefore,  g 

21  changes  signs  "at  alH-.  This  shows  that  v(t)  =  sgn(cV'b)  (or  sgn(-cV'b))  is  an  extremal  control. 

Now  consider  the  case  that  v  has  less  than  n  —  1  switches,  say  n  1  j  switches,  z  =  1 , 2, . . . ,  n  1  j  ■  For 
29  simplicity  arid  without  loss  of  generality,  assume  that  A  is  in  the  Jordan  canonical  form  (the  state  transformation 
matrix  can  be  absorbed  in  c’  and  (b).  Partition  A.  b  as 

★  ' 

bi 
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where  A\  is  of  size  n  -  j.  It  is  easy  to  see  that  A\  is  also  of  the  Jordan  canonical  form  and  (A\,b\)  is 
controllable.  Furthermore, 


Partition  c= [0  c,]'  accordingly,  then  c'eAtb  =  c[eA',bl.  By  the  foregoing  proof  for  the  full  dimensional  case, 
we  see  that  there  exists  ct  such  that  v(t)  =  sgn(c'leA'tbi)  is  a  bang-bang  control  with  switching  times  exactly 

at  1,2,. ..,n  1  j-  •  i  •  i  ,  — - 

Therefore,  we  conclude  that  any  bang— bang  control  with  less  than  n  —  1  switches  is  also  extremal.  LJ 
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Abstract 

We  present  controller  design  methods  to  smoothen  the  discontinuity  resulting  from  a 
piecewise  linear  control  (PLC)  law  which  was  proposed  to  improve  the  convergence  perfor¬ 
mance  for  systems  with  input  constraints.  The  continuous  control  laws  designed  in  this 
paper  are  explicit  functions  of  the  state  and  are  easily  implementable.  We  also  show  that  the 
convergence  performance  can  be  further  improved  by  using  a  saturated  high  gain  feedback 
law.  The  efficiency  of  the  proposed  methods  is  illustrated  with  the  PUMA  560  robot  model. 


Keywords:  Switching,  invariant  ellipsoid,  convergence  rate,  constrained  control 
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1  Introduction 

We  consider  a  linear  system  subject  to  input  saturation  and  state  constraint, 


x  —  Ax  +  Bu,  Moo  <  1,  x  €  n0,  (i) 

where  x  G  Rn,u  €  Rm,Moo  =  max{M|,  i  e  [l,m]}  and  fi0  contains  the  origin  in  its  interior. 
To  achieve  a  large  domain  of  attraction,  we  may  try  to  find  a  large  ellipsoid  (see  [2,  7]) 

£(P, p )  :=  {x  6  Rn  :  xTPx  <  p}  C  O0, 


with  0  <  P  €  Rnxn,  such  that  this  ellipsoid  is  invariant  under  u  =  Fx  and 

£(P,p)  C  C{F)  :=  {x  G  Rn  :  |Px|TO  <  l}  . 

For  simplicity,  we  use  £(P)  to  denote  £(P,  1).  Generally,  the  maximization  of  £(P,p)  would 
result  in  low  feedback  gain  F  and  slow  convergence  rate,  i.e.,  some  eigenvalues  of  A  +  BF  are 
close  to  the  imaginary  axis.  In  [7],  Wredenhagen  and  Belanger  proposed  a  PLC  design  method 
to  reconcile  large  domain  of  attraction  and  good  convergence  performance.  The  basic  idea  is  to 
use  LQ  method  to  construct  a  sequence  of  nested  ellipsoids 


£{Po,p0)  3  £{Pi,Pi)  3  •  •  O  £{Pn,Pn) 


along  with  corresponding  feedback  gain  matrices  Fi,i  =  0, 1, •  •  •  ,N,  such  that  £(Po,Po)  C  fio, 
£(Pi,Pi)  C  C(Fi),  and  each  £{Pupi)  is  invariant  under  the  feedback  u  =  FiX,i  =  0, 1,***  ,N. 
Also,  as  the  index  i  is  increased,  the  convergence  rate  under  the  feedback  u  =  F{X  increases. 
The  final  controller  takes  the  following  form: 


F/vx,  if  x  €  £{Pn,Pn), 

F/v-ix,  if  x  e  £(.Pjv-i,P;v-i)  \£{Pn,Pn), 


[  F0x,  if  x  6  £(P0,Po) \£{Pi,Pi)- 

In  this  way,  the  domain  of  attraction  is  ensured  to  include  the  largest  ellipsoid  £(P0,Po)  and  as 
a  state  trajectory  moves  from  an  outer  ellipsoid  to  an  inner  ellipsoid,  the  convergence  rate  is 
increased.  Since  each  ellipsoid  is  invariant  under  the  corresponding  feedback  law,  the  switch 
is  safe  (no  chattering)  and  the  existence  and  uniqueness  of  the  solution  to  the  closed-loop 
differential  equation  is  ensured.  Such  a  control  law  is  referred  to  as  PLC  in  [7].  Because 
£  [Pi .  pi)  C  C(Fi),i  —  0, 1,  •  •  ■ ,  N,  the  control  u  will  never  exceed  the  saturation  bound  if  the 

initial  state  xo  £  £(Po>  Po)- 

Since  F{  is  generally  different  from  Fi—\,  the  control  u  in  (2)  is  discontinuous  at  the  switching 
surface  d£{Pi ,  pi),  the  boundary  of  the  ellipsoid  £ (P, ,  pi).  Effort  has  been  made  to  smoothen  the 


1 


discontinuity  in  [3,  4,  5,  6],  etc.  In  [6],  a  continuous  feedback  law  was  constructed  from  the  linear 
combination  of  Fk  and  Fk+ 1.  Since  this  simple  interpolation  may  cause  the  control  to  exceed 
the  constraint,  smaller  bounds  on  the  control  were  imposed  and  the  ellipsoids  were  required 
to  be  “tightly”  nested  ( Pk  -  Pk+i  should  be  sufficiently  small).  By  using  the  gain  scheduling 
methods  in  [3,  4,  5],  it  has  been  shown  that  the  discontinuity  can  be  smoothened  by  using 
a  continuum  of  ellipsoids  £{P(e)),  where  e  is  a  scheduling  variable.  The  essence  of  these  gain 
scheduling  methods  is  the  following:  For  every  e  >  0,  P(e)  is  solved  from  a  parameter  dependent 
Riccati  equation  along  with  an  LQR  gain  matrix  F(s).  As  e  is  increased,  the  ellipsoid  £{P{e)) 
becomes  smaller  and  the  convergence  rate  within  £(P(e))  is  increased.  The  gain  scheduling 
idea  is  to  associate  each  x  €  Rn  with  a  parameter  e,  or,  to  define  a  function  e(x).  x  •-*  £- 
The  final  controller  has  the  form  of  u  =  F{e{x))x.  Since  the  function  e(«)  is  generally  very 
hard  to  compute,  technical  issues  are  involved  in  controller  implementation.  These  issues  were 
considered  in  [3]  and  a  method  to  simplify  the  computation  of  e(x)  was  proposed.  The  proposed 
method  involves  solving  a  convex  optimization  problem  for  every  point  x  in  the  state  space. 

This  note  is  intended  to  propose  explicit  controller  structures  which  would  achieve  the  objec¬ 
tive  of  improving  the  convergence  performance  using  continuous  control  laws.  For  easy  reference, 
here  we  collect  some  simple  mathematical  facts  as  follows. 


Fact  1  For  two  ellipsoids  £(Pi)  and  £(P2), 

£(Pi)  C  £{P2)  *=*  Pi  >  Pr, 


£(Pi)  C  int(£(P2))  «=*•  ft  >  P2; 

where  int(£(P2))  =  {x  6  Rn  :  xTP2x  <  1}  is  the  interior  of£{P2).  For  an  ellipsoid  £{P)  and  a 
matrix  F  €  Rmxn, 


£{P)CC(F) 


fffi  <  P \ 
1 

P'lfl 


i  e  [1  ,m] 
fiP-1 


>o, 


fiP-1!?  < 

i  €  [l,m]. 


1, 


i  €  [l,m] 


2  A  continuous  feedback  law  for  improving  the  performance 


We  consider  the  system 


x  =  Ax  +  Bu, 


|u|oo  <  1,  ®  €  fto, 


with  a  two  stage  switching  feedback  law 


u  = 


F\x,  if  x  e  £(Pi), 

Fqx,  if  x  €  £(P0)  \  int(5 (Pi)), 


(3) 

(4) 


2 


where 


(5) 

(6) 
(7) 


PQ  <  Pu  il0De{P0),  £(P0)cC{Fo),  €{Pi)cC{Fi), 

(. A  +  BF0)TPo  +  Po{A  +  BF0)  <  - a0P0 , 

{A  +  BFi)TPi  +  Pi{A+  BFi)  < 

and  0  <  0!o  <  «i-  Assume  that  a0  and  Qi  are  the  maximal  positive  numbers  that  satisfy  (6) 
and  (7),  respectively.  The  inequality  a0  <  <*i  implies  that  the  convergence  rate  of  the  Lyapunov 
function  Vi(x)  =  xrPxx  under  u  =  Fxx  is  greater  than  that  of  Vq{x)  =  xTPox  under  u  =  F0x. 
We  consider  a  feedback  law  (4)  of  only  one  switch  because  the  method  to  be  proposed  can  be 
readily  extended  to  smoothen  the  discontinuity  of  a  controller  with  multiple  switches.  Actually, 
because  the  proposed  continuous  feedback  law  guarantees  a  progressively  increasing  convergence 
rate,  we  only  need  to  use  the  outmost  and  the  innermost  ellipsoids  £ (Po,  po)  and  £(Pn,  Pn)  along 
with  their  corresponding  feedback  gain  matrices  Po  and  Pat.  Without  loss  of  generality,  we  have 
assumed  that  po  —  px  —  1.  Otherwise,  po  and  pi  can  be  absorbed  into  the  matrices  Po  and  Pi* 
The  control  (4)  is  discontinuous  at  the  surface  of  the  inner  ellipsoid,  d£{P\).  The  main  idea 
for  smoothening  this  discontinuity  is  to  construct  a  continuum  of  ellipsoids  £(P(t))>7  €  [0, 1], 
between  £(Po)  and  £(Pi),  progressively  shrinking,  along  with  a  continuum  of  feedback  matrices 
P( 7),  such  that 

£(P(7))C£(P(  7)) 

and 

{A  +  PP(7))tP(7)  +  P(7)(A  +  PP(7))  <  -a(7)P(7), 

with  a(7)  monotonically  increasing  as  7  changes  from  0  to  1.  For  x  G  d£(P{ 7)),  we  use  the 
control  u  =  P(7)x.  Suppose  that  for  every  x  £  £(P0)\int(£(Pi)),  there  exists  a  unique  7  £  [0, 1] 
such  that  xrP{j)x  =  1,  then  we  can  define 

'fix)  :=  {7  £  [0, 1]  :  xTP{'f)x  =  1},  (8) 

and  the  feedback  law  can  be  simply  written  as 

u  =  P(  7(x))x.  (9) 

The  control  law  (9)  is  implementable  if  the  function  7(x)  and  the  feedback  matrix  P(7(x))  can 
be  computed  efficiently  on  line.  That  is,  we  should  be  able  to  tell  which  surface  of  the  ellipsoids 
the  state  x  is  on.  This  depends  on  how  we  design  the  functions  P(7)  and  F(j). 

The  following  are  the  functions  we  propose.  Let 

Qo=Pq\  Qi  =  PC1’  Ho  =  F0Qo,  Hl  =  F1Q1. 
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Define 

Q(j)  :=  (l-7)Qo  +  7<9ii  # (t)  :=  (1  ~  7)#o  +  7#i  (10) 

and 

P(7)  :=  Q(7)_1,  ^(7)  :=  (n) 

It  is  clear  that  Q(7)  >  0  for  all  7  G  [0, 1].  Hence  Q(j),  H{ 7),  Pfr)  and  F(7)  are  all  continuous 
in  7  over  the  interval  [0, 1].  Same  function  Q{ 7)  was  used  in  [3],  where  F{ 7)  was  the  solution  to 
a  Riccati  equation.  In  what  follows,  we  show  that,  with  F (7 )  defined  as  above,  the  continuous 
feedback  law  u  =  F{ j(x))x  possesses  all  the  desired  properties.  We  will  also  provide  an  explicit 
formula  to  compute  j(x). 

Theorem  1  With  P( 7)  defined  in  (11),  there  exists  a  unique  7  G  [0, 1]  such  that  xTP{'j)x  =  1 
for  every  x  G  6{P0)  \  int(£(Pi)).  With  7(1)  defined  in  (8),  we  have 

7(a)  =  Amin  [(Qo  -  (<2o  -  xxT)(Q0  -  Qi)"*]  ,  (12) 

for  x  G  £(P0)  \  int(£(Pi)).  Let  7(a)  =  1  for  x  G  int(£(Pi)).  Then  the  control  u  =  F(rt(x))x  is' 
continuous  in  x  and  |P(7(*))®|  <  1  for  all  x  G  5(P0).  Moreover,  each  ellipsoid  £{P{ 7)), 7  € 
[0,1]  is  invariant  and  every  trajectory  starting  from  x0  G  £{P0)  will  converge  to  the  origin  with 
increasing  rate . 

Before  proving  Theorem  1,  we  present  two  lemmas.  Define 

0(7)  :=  max  {a  >  0  :  (A  4-  £?P(7))tP(t)  +  P( 7)(^  +  BF{ 7))  <  -oP(7)}  • 

Then  <*(7)  is  the  convergence  rate  of  V(x)  =  xTP( 7)®  under  the  linear  control  u  =  P(7)*- 

Lemma  1 

i.  £(P(y))  shrinks  as  7  increases,  namely,  if  71  <  72,  then  £{P{ 72))  C  int(£(P(7i))); 

5.  For  all  7  G  [0,1],  £(P(7))  C  £(P(t)); 

5.  0(7)  ts  strictly  increasing  for  7  G  [0, 1], 

Proof.  Prom  (5),  we  have  Qo  —  <2i  =  Po  1  —  A  1  > 

1.  If  71  <  72,  then 

Q{j 1)  -  <3(72)  =  (72  -  71XQ0  ~  Qi)  >  0. 

Hence  P(7i)  <  P( 72)  and  it  follows  from  Fact  1  that  £(P{ 72))  C  int(£(P(7i)). 
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I 


2.  Since  £(P0)  C  £(F0)  and  £{Pi)  C  £(FX),  it  follows  from  Fact  1  that 

1 


1  foiP0 1 

0—1  XT  P“1 

<0  iOi  M) 


i.e., 


1  /lot 

/iJi  Qo 


>0, 


>0, 


pr'fu  prl 


hiP{1 

)“ 

1 


>  0,  i  G  [l,m], 


1  /iii 

Qi 


>  0,  ie[l,m]. 


By  convexity,  we  have 


1  hi( 7) 

htT(7)  Q(7) 


That  is, 


>0,  i€[l,m],  7  G  [0, 1]. 

/»( 7)F  (7)  I  >  q,  ^  g  [l,m],  7  €  [0,1]. 


F"1(7)/ir(7)  F-1(7) 

Therefore,  by  Fact  1,  we  have  £(F(7))  C  C(F(y))  for  all  7  €  [0, 1]. 

3.  By  multiplying  both  sides  of  (6)  and  (7)  with  Qo  and  Q 1  respectively,  we  obtain 

Q0Ar  +  AQo  +  Hi BT  +  BH0  <  -a0Qo, 

QiAT  +  AQi  +  H?Br  +  BH\  <  -<*iQi. 

By  convexity,  we  have 

Q{i)Ar  +  AQi'r)  +  F(7)tFt  +  BH{ 7)  <  -(1  -  7)<*oQo  ~  7<*iQb  7  G  [0,  !]• 

Since  07  >  ao  and  Qi  >  0,  we  see  that 

(1  -  7)ooQo  +  laiQi  =  «o<3(7)  +  7(ai  -  «o)Qi  >  aoQ(7)- 

It  follows  that  0(7)  >  <*0  for  all  7  £  (0, 1].  To  show  that  0(72)  >  0(71)  for  72  >  7b  we  observe 
that 


and 


72  =  | 

72  -  71 
l  l-7i 

\  ,72-7i 

J71+X-7i’ 

QM  =  £ 

1— t 

^  F 

1  1 

fi 

1 

Hi  72)  =  (: 

1-4  , 

P 

1  1 
F  - 
1 

Following  the  same  procedure  by  replacing  Qo  with  Q(7i)>  #0  with  H( 71),  and  7  with  , 
we  can  show  that  0(72)  >  0(71 )  -for  72  >  7i-  D 
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Lemma  2  For  every  x  G  £ (Po)\int(£(Pi)),  t^iere  exists  a  um'?ue  7  €  [0, 1]  suc/i  that  xTP{i)x  = 
1.  Lei  7(2;)  he  defined  in  (8).  Then,  for  x  €  £ (Po)  \  int(£(Pi)), 

j{x)  =  Amin  [(Qo  -  <2i)~2(Qo  -  zzT)(Qo  -  Qi)-’]  .  (13) 

Proof.  For  each  x  G  £(Po)  \  int(£(Pi)),  xve  have  x^Pqx  <  1  and  xTP\x  >  1,  i.e.,  x  P(0)x  <  1 
and  xTP(l)x  >  1.  Since  P(j)  is  continuous  in  7  for  7  G  [0, 1],  there  exists  a  7  G  [0,1]  such 
that  xtP('y)x  =  1.  By  Lemma  1  item  1,  there  exists  a  unique  7  G  [0, 1]  such  that  xTP(j)x  =  1. 
Hence  the  function  j(x)  is  well  defined  by  (8). 

Let  7  be  the  unique  number  in  [0, 1]  such  that  xTP{^)x  =  1,  i.e.,  x  G  d£(P( 7)).  By  Lemma  1 
item  1,  x  G  int(£(P(7i)))  for  all  71  G  [0,7),  i.e., 

a:TP (71)2:  <1,  V71  G  [0,7). 


It  follows  from  Schur  complement  that 


’  1  XT 

x  Q(7i) 

.  J 

>0 


1  xT 

x  Qo  —  Ti(Qo  —  Qi) 

Qo-iiiQo-Qi)  -xx^  >0 

7XJ  <  (Qo  ~  Qi)-^(Qo  —  xxT)(Qo  -  Qi)~K  71  G  [0,7). 


By  continuity,  we  have 

7I  <  (Qo  -  Qi)_*(Qo  -xxT)(Q0  -  Qi)-^. 


From  xrP{y)x  =  1,  we  have, 


0 


det 


1  xT 
x  Q( 7) 

det  [Q(7)  -  xxT] 

det  [Qo  -  7(<3o  -  Qi)  ~  xxr] . 


(14) 


Hence, 

det  [7/  -  (Qo  -  Qi)"2(Q0  -  xxT)(Qo  -  Qi)-^]  =  0,  (15) 

which  implies  that  7  is  an  eigenvalue  of  the  matrix  (Q0  -  Qi)-2(Qo  -  xxT)(Q0  -  Qi)“5-  In 
view  of  (14),  we  obtain  (13).  D 

Proof  of  Theorem  1.  The  first  statement  and  equation  (12)  have  been  proved  in  Lemma  2. 
From  the  continuity  of  the  eigenvalues  of  a  matrix  in  its  elements,  it  follows  that  7(2:)  is  contin¬ 
uous  in  x  at  every  x  G  £(P0)  \  int(£(Px)).  Since  7(x)  =  1  for  all  x  G  S£(Pi),  the  function  7(2:) 
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can  be  extended  continuously  to  all  x  G  £(Po)  by  letting  j(x)  =  1  for  x  G  £(Pl).  Since  F( 7)  is 
continuous  in  7,  the  control  u  =  F(j(x))x  is  continuous  in  x.  The  claim  that  |P(7(x))x|oo  <  1 
for  all  x  G  £(Po)  follows  directly  from  Lemma  1  item  2. 

Now  we  consider  the  convergence  of  trajectories.  Under  the  control  u  =  F(j(x))x,  on  the 
houndary  of  each  £(P(7)),  7  G  [0, 1], 

xTP( j)x  =  \xr{{A  +  BF(j))rP  +  P{A  +  BF{ 7))x  <  ~a(7)xTP(7)a:  <  0. 

We  also  have  xTP\x  <  0  for  all  x  €  S{P\).  Hence  all  the  trajectories  starting  from  the  boundary 
of  £(P{ 7))  will  be  in  the  interior  of  £(P(7))  for  all  t  >  0.  This  proves  the  invariance  of  £ (P( 7))- 
Moreover,  the  convergence  rate  0(7)  increases  as  the  trajectory  enters  the  inner  ellipsoids. 
Therefore,  if  a  trajectory  strats  from  x0  G  £(Po),  it  will  converge  to  the  origin.  □ 

3  Further  improvement  of  the  convergence  performance 

As  can  be  seen  from  Lemma  1  item  2,  the  control  law  constructed  in  Section  2  satisfies  the 
control  constraint  by  avoiding  saturation.  Since  £(P( 7))  C  C(F( 7)),  there  are  at  most  two 
intersections  between  the  ellipsoid  £(P{'r))  and  a  pair  of  hyperplanes,  /»( j)x  =  ±1.  Hence 
the  control  =  fi(j)x  may  take  the  maximal  value  ±1  only  at  two  points  on  d£{P{'y)). 
Along  a  trajectory,  the  control  signal  could  be  well  below  the  saturation  level  most  of  the 
time.  This  means  that  the  capacity  of  the  actuators  is  not  fully  utilized  and  we  still  have  much 
potential  to  improve  the  convergence  performance.  In  [1],  it  is  shown  that  the  control  law  that 
maximizes  the  convergence  rate  of  a  Lyapunov  function  V(x)  =  xTPx  under  actuator  saturation 
is  simply  ui  =  — sign (bjPx'),i  —  1, 2,  •  •  • ,  m.  Due  to  the  discontinuity  of  this  bang  bang  control, 
a  saturated  high  gain  linear  feedback  law  of  the  form  u  =  -sat  (kBTPx)  is  proposed  to  achieve 
a  suboptimal  convergence  rate.  Here,  sat(-)  is  the  standard  vector- valued  saturation  function. 
{sat(u)}j  =  sign(uj)  min{|uj|,  1}.  It  is  also  shown  that  the  maximal  convergence  rate  depends 
on  the  choice  of  the  P  matrix  (see  Chapter  11  of  [1]  for  more  detail).  Generally,  the  objective 
of  producing  a  high  convergence  rate  conflicts  with  the  objective  of  achieving  a  large  invariant 
ellipsoid.  In  other  words,  if  P  is  chosen  such  that  the  maximal  convergence  rate  is  high,  then  the 
largest  ellipsoid  £{P,p)  that  can  be  made  invariant  would  be  small.  A  simple  way  to  reconcile 
the  objective  of  producing  a  large  invariant  ellipsoid  and  that  of  achieving  a  high  convergence 
rate  with  a  control  u  =  -sat (kBTPx)  is  also  to  adjust  the  P  matrix  according  to  the  size  of 
the  state.  Using  the  method  in  Section  2,  a  state  dependent  matrix  P(7(x))  can  be  determined. 
While  the  state  feedback  u  =  F{y{x))x  increases  the  convergence  rate  as  the  trajectory  enters 
smaller  ellipsoid  £{P( 7)),  a  state  feedback  of  the  form  u  =  -sa,t(kBTP(j(x))x)  with  a  high  gain 
k  can  be  used  for  further  improvement  of  the  convergence  performance. 
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Theorem  2  Let  Fq  =  —GqB^Pq  and  F\  =  —G\B^P\  be  the  feedback  matrices  of  two  LQ 
controllers  such  that  £(Po)  C  jC.(Fq),  £(Pi)  C  £(Fi)  and  Pi  <  Pq ■  Assume  that  Go  = 
diag{<?oi-) 502,503}  >  0  and  Gi  =  diag{<?n, gw,9i3}  >  0-  Let  ^0  =  max{goi ><?02)303) 3n? 512,513} • 
Then  for  any  k  >  ko,  under  the  control  of 

u  =  -sa.t(kBTP(y(x))x),  (16) 

all  the  trajectories  starting  from  £(P0)  will  converge  to  the  origin.  The  convergence  rate  increases 
as  k  increases. 


Proof.  Denote  £(7)  =  (1  -  y)Go  +  7G1.  Then  0  <  G{ 7)  <  k0I  for  all  7  €  [0, 1]  and  ^(7)  = 
-G(7)jBtP(7).  It  follows  from  Theorem  1  that  under  the  control  of  u  =  F(y(x))x,  all  the 
trajectories  starting  from  £{P0)  will  converge  to  the  origin.  Also  we  have  |F(7(x))x|00  <  1  for 
all  x  €  £(Po).  The  convergence  rate  is  faster  under  (16)  for  k  >  ko  can  be  seen  from 


-xrP(T)bi  s&t(kbj  P(y)x)  <  -xrP(T)bi  sat(gi(7)bJP(y)x)  =  xTP(j)bifi(y)x,  (17) 

where  gi{ 7)  is  the  ith  diagonal  element  of  G(y).  As  k  increases,  the  left-hand  side  of  (17) 
decreases.  Hence  the  convergence  rate  increases  as  k  increases.  D 


Since  both  sat(-)  and  P( y(-))  are  continuous  functions,  the  control  (16)  is  continuous  in  x. 
We  call  (16)  the  fast  continuous  control  law.  As  will  be  seen  in  the  example,  the  feedback  law 
(16)  can  improve  the  convergence  rate  significantly  over  u  =  F(y{x))x. 

Example:  We  consider  the  Puma  560  robot  model  that  was  used  in  [7].  The  robot  has  three 
joints:  the  trunk  (Joint  1),  the  shoulder  (Joint  2)  and  the  elbow  (Joint  3).  These  joints  are 
controlled  by  three  actuators  which  are  subject  to  different  saturation  bounds,  97.8Nm,  136.4Nm, 
and  89.4Nm,  respectively.  The  linear  model  was  calculated  about  (61,62,03)  =  (57°,  115°,  172°) 
with  resulting  system  matrices 

0  0  O' 

0  0  0 

0  0  0 

0.0925  0.0000  0.0026 

0.0000  0.0979  -0.0952 

0.0026  -0.0952  0.3616  . 


•  0 

0 

0 

1 

0 

0  ' 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

1 

,  B  = 

0 

-0.0451 

-0.0451 

0 

0 

0 

5 

0 

-0.0457 

-0.0457 

0 

0 

0 

0 

-4.5551 

-4.5551 

0 

0 

0 

In  [7],  a  PLC  control  law  with  5  switches  was  designed.  Based  on  the  outmost  and  the  innermost 
ellipsoids  of  [7],  with  corresponding  feedback  matrices,  we  designed  a  continuous  feedback  law 
of  the  form  u  -  F(y(x))x  (Here  we  need  to  take  into  account  the  non-unity  saturation  bounds 
of  the  three  actuators).  Figs.  1  and  2  illustrate  the  simulation  results  under  the  PLC  law  and 
the  continuous  feedback  law.  The  initial  condition  is  xq  =  10[1  1111  l]T/v/6,  which  is  the 
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Figure  1:  Time  responses  of  the  states:  PLC  vs  continuous  control 


same  as  that  in  [7].  From  Fig.  1,  we  can  see  that  the  time  response  of  the  states  under  the 
PLC  control  and  that  under  the  continuous  feedback  control  are  almost  identical.  The  control 
signals  under  the  PLC  law  are  however  discontinuous  and  display  big  spikes  (see  Fig.  2).  These 
spikes  can  be  reduced  by  increasing  the  number  of  the  nested  ellipsoids  and  the  controllers  used 
in  switching.  However,  this  would  increase  the  numerical  burden  when  determining  the  smallest 
ellipsoid  that  includes  a  given  state  and  would  also  increase  the  data  storage  for  the  controller. 
The  control  signals  under  the  continuous  control  law  are  continuous,  as  expected. 

From  Fig.  2,  we  also  see  that  the  control  signals  are  well  below  the  saturation  level.  This 
indicates  that  there  is  a  potential  for  further  improvement  of  the  performance.  We  use  the 
controller  (16)  for  this  purpose.  Recall  that  we  have  assumed  unity  saturation  level  in  (1)  and 
(16)  is  only  suitable  for  systems  with  unity  saturation  level.  To  transform  the  system  into  the 
standard  form  of  (1),  let  A  =  diag{97.8, 136.4, 89.4},  B  =  BA  and  u  —  A~xu.  Then  the  system 
x  =  Ax  +  Bu  has  a  unity  saturation  level.  For  this  system,  the  fast  continuous  control  law  is 
u  =  -sa.t{kBTP(y(x))x.  Equivalently,  u  =  Au  =  -Asa,t(kABTP('y(x))x).  The  actual  controllers 
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Torque  at  Joint  1 


Figure  2:  The  control  signals:  PLC  vs  continuous  control 


have  the  following  forms: 

'  ui  =  -97.8sat(97.8 kbJP(-y{x))x), 

i  u2  =  -136.4  sat(136.4feft£P(7(®))s),  (18) 

u3  =  -89.4sat(89.4fc6jF(7(x))a:). 

Here,  in  the  construction  of  P( 7),  we  have  used  the  outmost  and  the  innermost  ellipsoids  in  [7]. 
To  make  full  use  of  the  actuator  capacities,  we  have  taken  k  =  6  in  simulation.  Figs.  3  and  4 
illustrate  the  simulation  results  under  the  control  (18)  (the  solid  curves)  as  compared  with  those 
under  the  control  u  =  F(j{x))x  (the  dashed  curves).  From  Fig.  3,  we  see  that  the  performance  of 
the  state  response  is  significantly  improved  by  using  the  fast  continuous  control  law  (18).  Fig.  4 
shows  that  this  control  law  has  utilized  more  potential  of  the  actuator  capacities.  We  notice  that 
there  is  a  sharp  turn  (not  discontinuity)  in  the  torque  at  Joint  1.  This  may  happen  when  the 
state  trajectory  enters  the  smaller  ellipsoid  £  (Pi),  since  at  the  intersection  between  a  trajectory 
with  the  boundary  of  this  ellipsoid,  the  function  j(x)  is  continuous  but  not  differentiable  in  x. 
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Figure  3:  Time  response  of  the  states:  continuous  control  vs  fast  continuous  control 


4  Conclusions 


We  developed  simple  continuous  feedback  laws  for  improving  the  convergence  performance  of 
linear  systems  subject  to  actuator  and  state  constraints.  The  control  laws  are  expressed  as 
explicit  functions  of  the  state  and  are  easily  implementable.  The  efficiency  of  the  proposed 
methods  is  illustrated  with  a  PUMA  560  robot  model. 
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Abstract 

A  Lyapunov  function  based  on  a  group  of  quadratic  functions  is  introduced  in  this  paper. 
We  call  this  Lyapunov  function  a  composite  quadratic  function.  Some  important  properties  of 
this  Lyapunov  function  are  revealed.  We  show  that  this  function  is  continuously  differentiable 
and  its  level  set  is  the  convex  hull  of  a  group  of  ellipsoids.  These  results  are  used  to  study  the 
set  invariance  properties  of  linear  systems  with  input  and  state  constraints.  We  show  that 
for  a  system  under  a  given  saturated  linear  feedback,  the  convex  hull  of  a  group  of  invariant 
ellipsoids  is  also  invariant.  If  each  ellipsoid  in  a  group  can  be  made  invariant  with  a  bounded 
control  of  the  saturating  actuator,  then  their  convex  hull  can  also  be  made  invariant  by  the 
same  actuator.  For  a  group  of  ellipsoids,  each  invariant  under  a  separate  saturated  linear 
feedback,  we  also  present  a  method  for  constructing  a  nonlinear  continuous  feedback  law 
which  makes  their  convex  hull  invariant. 

Keywords:  Quadratic  functions,  invariant  set,  constrained  control 
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1  Introduction 


We  consider  linear  systems  subject  to  input  saturation  and  state  constraint.  Control  problems 
for  these  systems  have  attracted  tremendous  attention  in  recent  years  because  of  their  practical 
significance  and  the  theoretical  challenges.  For  linear  systems  with  input  saturation,  global 
and  semi-global  stabilization  results  have  been  obtained  for  semi-stable  systems1  (see,  e.g., 
[15,  16,  19,  21,  22,  23])  and  systems  with  two  anti-stable  poles  (see  [12,  8]).  For  more  general 
systems  with  both  input  saturation  and  state  constraint,  there  are  numerous  research  reports 
on  their  stability  analysis  and  design  (see  [1,  5,  6,  8,  18,  25]  and  the  references  therein).  While 
analytical  characterizations  of  the  domain  of  attraction  and  the  maximal  (controlled)  invariant 
set  have  been  attempted  and  are  believed  to  be  extremely  hard  except  for  some  special  cases 
(see,  e.g.,  [12]),  most  of  the  literature  is  dedicated  to  obtaining  an  estimation  of  the  domain 
of  attraction  with  reduced  conservatism  or  to  enlarge  some  invariant  set  inside  the  domain  of 
attraction.  Along  this  direction,  the  notion  of  set  invariance  has  played  a  very  important  role 
(see,  e.g.,  [2,  3,  25]).  The  most  commonly  used  invariant  sets  for  continuous-time  systems  are 
invariant  ellipsoids,  resulting  from  the  level  sets  of  quadratic  Lyapunov  functions.  The  problem 
of  estimating  the  domain  of  attraction  by  using  invariant  ellipsoids  has  been  extensively  studied, 
e.g.,  in  [4,  5,  7,  14,  17,  24,  25].  More  recently,  we  developed  a  new  sufficient  condition  for  an 
ellipsoid  to  be  invariant  in  [11]  (see  also  [8]).  It  was  shown  that  this  condition  is  less  conservative 
than  the  existing  conditions  resulting  from  the  circle  criterion  or  the  vertex  analysis.  The  most 
important  feature  of  this  new  condition  is  that  it  can  be  expressed  as  LMIs  in  terms  of  all  the 
varying  parameters  and  hence  can  easily  be  used  for  controller  synthesis.  A  recent  discovery 
makes  this  condition  even  more  attractive.  In  [9],  we  showed  that  for  the  single  input  case,  this 
condition  is  also  necessary,  thus  the  largest  ellipsoid  obtained  with  the  LMI  approach  is  actually 
the  largest  one. 

In  this  paper,  we  will  introduce  a  new  type  of  Lyapunov  function  which  is  based  on  a  group 
of  quadratic  functions.  This  is  motivated  by  problems  arising  from  estimating  the  domain  of 
attraction  and  constructing  controllers  to  enlarge  the  domain  of  attraction.  Suppose  that  there 
are  a  group  of  invariant  ellipsoids  of  the  closed-loop  system  under  a  saturated  feedback  law.  It  is 
clear  that  the  union  of  this  group  of  ellipsoids  is  also  an  invariant  set  of  the  closed  system.  The 

1 A  linear  system  is  said  to  be  semi-stable  if  all  its  poles  are  in  the  closed  left-half  plane. 
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question  whether  the  convex  hull  of  this  group  of  ellipsoids,  a  set  potentially  much  larger  than 
the  union,  is  invariant  remains  unclear.  Another  problem  is  related  to  enlarging  the  domain  of 
attraction  by  merging  two  or  more  feedback  laws.  Suppose  that  we  have  two  ellipsoids,  each 
invariant  under  different  feedback  laws.  In  [13],  we  have  shown  that  a  switching  feedback  law  can 
be  constructed  to  make  the  union  of  the  two  ellipsoids  invariant.  We  would  further  like  to  make 
the  convex  hull  invariant,  possibly  with  a  continuous  feedback  law.  Although  the  discontinuity 
of  the  switching  feedback  law  in  [13]  does  not  cause  chattering  and  guarantees  the  existence  and 
uniqueness  of  solution,  a  continuous  feedback  law  would  be  more  appealing. 

In  this  paper,  we  will  study  the  invariance  of  the  convex  hull  of  a  group  of  ellipsoids  by  using 
a  new  Lyapunov  function  which  is  based  on  a  group  of  quadratic  functions.  The  Lyapunov 
function  is  defined  in  such  a  way  that  its  level  set  is  the  convex  hull  of  a  group  of  ellipsoids.  A 
nice  feature  of  this  function  is  that  it  is  continuously  differentiable  in  the  state  x.  This  makes 
it  possible  to  construct  continuous  feedback  laws  based  on  the  gradient  of  the  function  or  on  a 
given  set  of  linear  feedback  laws. 

We  first  use  the  Lyapunov  function  to  study  the  invariant  sets  of  a  linear  system  under  the 
control  of  a  saturated  linear  feedback.  We  will  show  that  if  each  ellipsoid  in  a  group  is  invariant 
by  the  condition  of  [11],  then  their  convex  hull  is  also  invariant.  We  then  extend  this  result  to 
systems  with  a  class  of  saturation-like  nonlinearities.  We  will  further  show  that  if  each  ellipsoid 
in  a  group  can  be  made  invariant  with  saturating  actuators,  then  their  convex  hull  can  also  be 
made  invariant.  Finally,  we  will  construct,  from  a  group  of  saturated  linear  feedback  laws,  a 
continuous  nonlinear  feedback  law  which  makes  the  convex  hull  invariant.  For  the  convex  hull 
of  two  ellipsoids,  an  explicit  formula  for  the  feedback  law  is  derived. 

The  composite  quadratic  function  is  motivated  from  the  study  of  control  systems  with  satu¬ 
rating  actuators  and  state  constraints,  it  is  a  potential  tool  to  handle  more  general  nonlinearities, 
as  will  be  demonstrated  in  this  paper. 

This  paper  is  organized  as  follows.  In  Section  2,  we  introduce  the  composite  quadratic 
Lyapunov  function  and  show  that  this  function  is  continuously  differentiable  and  its  level  set 
is  the  convex  hull  of  a  group  of  ellipsoids.  In  Sections  3  -  5,  we  use  these  properties  of  the 
Lyapunov  function  to  study  the  set  invariance  of  linear  systems  with  input  and  state  constraints. 
In  particular,  we  will  show  in  Section  3  that  under  a  given  saturated  linear  feedback,  the  convex 
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hull  of  a  group  of  invariant  ellipsoids  is  also  invariant.  In  Section  4,  we  will  study  the  controlled 
invariance  of  the  convex  hull.  In  Section  5,  we  will  present  a  method  for  constructing  a  nonlinear 
continuous  controller  which  makes  the  convex  hull  invariant.  Section  6  draws  the  conclusions  to 

this  paper. 

Notation:  We  use  sat(-)  to  denote  the  standard  vector  valued  saturation  function.  For  u  G  R771, 
the  ith  component  of  sat(u)  is  {sat(u)}i  =  sign(uj)  min{l,  |«i|}.  We  use  |u|oo  and  M2  to  denote 

respectively  the  infinity  norm  and  the  2-norm. 

Let  P  G  RnXn  be  a  positive-definite  matrix  and  p  be  a  positive  number.  Denote 

£(P,p)  :=  {x  G  Rn  :  xTPx  <  p}. 

For  simplicity,  we  use  £{P)  to  denote  £(P,  1).  For  a  matrix  F  G  Rmxn,  denote  the  ith  row  of  F 
as  fi  and  define 

C{F)  :=  {x  G  R”  :  |M|  <  l,i  G  [1,  m]}. 

If  F  is  the  feedback  matrix,  then  £(F)  is  the  region  in  the  state  space  where  the  control 
u  =  sat  (Fa:)  is  linear  in  x.  For  xQ  G  Rn  and  r  >  0,  denote  B(x0,r)  =  {x  €  Rn  :  \x-  x0\2  <  r). 

2  The  composite  quadratic  function 

With  a  positive  definite  matrix  P  G  Rnxn,  a  quadratic  function  can  be  defined  as  V(x)  x  Px. 
For  a  positive  number  p,  a  level  set  of  V(x),  denoted  Ly(p),  is 

Lv(p)  :=  {a:  G  Rn  :  V(x)  <  />}  =  £(P,p)- 

In  this  paper,  we  will  be  interested  in  a  function  determined  by  a  group  of  positive  definite 
matrices  Pi,  P2,---,P/^  G  Rnxn.  Let  Qj  =  Pf\j  G  [1,  N].  For  a  vector  7  G  RN,  define 

Q( 7)  :=  jQf  P^i)  ~  Q' _1(7)- 

3= 1 

Let 

T  =  {7  G  R^  :  71  +  72  +  +  7N  =  hlj  >  0. 3  e  [1, W]}  . 

It  is  easy  to  see  that  Q(7),P( 7)  >  0  for  all  7  G  F  and  these  two  matrix  functions  are  analytic 

in  7  G  r.  The  composite  quadratic  function  is  defined  as 

V^,(a:)  :=  min  xTP(/y)x.  (1) 

7er 
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For  p  >  0,  the  level  set  of  Vc(x)  is 


LVC{P )  :=  {x  €  Rn  :  Vc(x)  <  p| . 

A  very  useful  property  of  this  composite  quadratic  function  is  that  its  level  set  is  the  convex 
hull  of  the  level  sets  of  xTPjx,  the  ellipsoids  £(Pj,  p),  j  E  [1,  N].  Another  nice  property  of  Vc(x ) 
is  that  it  is  continuously  differentiable.  In  order  to  establish  these  results,  we  need  some  simple 
preliminaries. 

Fact  1  [8,  10].  For  a  vector  fo  E  Rlxn  and  a  matrix  P  >  0,  £(P)  C  £(/o)  if  and  only  if 

foP  VoT  <  1  ^ ^  P~lfo  ^°p~l  —  0* 

1)  The  equality  /oP'Vcf  =  1  holds  if  and  only  if  the  ellipsoid  £(P )  touches  the  hyperplane 
fox  =  1  at  Xo  5=  P^fo  (the  only  intersection),  i.e., 

1  =  fo%o  >  fox  Vx  €  £ (P)  \  {xo}. 


2)  If  foP-'ff  <  1,  then 

and  the  ellipsoid  £{P)  lies  strictly  between  the  hyperplanes  fox  =  1  and  fox  =  —  1  without 
touching  them . 

A  dual  result,  which  will  be  useful,  can  be  obtained  by  exchanging  the  roles  of  fo  and  £g . 
Given  xq  and  suppose  that  x^Px o  =  1,  fo  =  Px o,  then 

1  =  foxo  >  fx o  V/T  e  £{P~X)  \  {/oT}. 


For  F  G  Rmxn,  C(F)  =  n ^(/i)  and  £{P)  c  C(F)  if  and  only  if  fiP~lf?  <  1  for  all 
i  G  [1,  m].  Denote  the  convex  hull  of  the  ellipsoids  £(Pj,p),j  G  [1,  N]  as 


co  {£(Pj,p)J  G  [1,  JV]}  := 


|  :  x3  e  £(pj>P):l  €  rJ 


Then  we  have 


Theorem  1  LVc(p)  =  co  {S(Pj,p),  j  6  [l,iV]}  =  U7er^(^(7),p)- 
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Proof.  It  is  obvious  that  Vc(kx)  =  k2Vc(x),  so  Lyc(p)  =  y/pLye{l).  Since  £(P,p)  —  ^/p£(P), 
it  suffices  to  show  that 

LVc{l)=co{£(Pj),j  €  [1  ,m}  =  u  Wt))- 

oer 

We  first  show  that  co  |£ (Pj),  j  G  [1,  iV]j  C  Lvrc(l)-  Suppose  that  a:  G  co  €  [1,IV]|, 

then  there  exists  a  7  G  T  and  Xj  G  £(Pj),j  G  [1,  jY],  such  that 


X  =  71S1  +  72^2  H - 1-  1NXN- 


Since  Xj  G  £(Pj),  we  have  xJPjXj  <  1,  which  is  equivalent  (by  Schur  complement)  to 


x- 


>0, 


xj  Qj 

Recalling  that  Q( 7)  =  JiQi  +  72Q2  d - h  JnQn, 

T  1  xT 

x  <3(7) 


J€[1,JV]. 

we  have,  by  the  convexity, 
>0, 


which  implies  that  xrP(-y)x  <  1.  It  follows  that  Vc(x)  <  1  and  x  G  Lyc(  1). 

We  next  prove  that  U7er^(p(7))  C  co{£(P,),j  G  [1,1V]}.  It  suffices  to  show  that  £ (Pfr))  C 
co  [£(Pj)J  G  [1,1V]}  for  every  7  G  T.  Let  7  be  any  vector  in  the  set  T.  One  way  for  the  proof 
is  to  show  that  for  any  x  G  £(P( 7)),  there  exist  a  7  G  T  and  a  group  of  Xj  e  £(Pj),j  €  [1,N], 

such  that  x  =  71X1 H - \"7nxn-  But  this  approach  seems  to  be  not  easy.  Instead,  we  will  prove 

£(P( 7))  C  co  {£(Pj),j  G  [1,1V]}  by  using  Fact  1.  Suppose  on  the  contrary  that  there  exists  an 
x0  G  £(P( 7))  and  x0  $  co  [£(Pj),j  G  [1,1V]}.  Then,  there  exists  a  vector  h  G  Rlxn  such  that 

hxo  >  hx  Vx  G  co  {£(Pj),j  G  [1,1V]} . 


Let  x*  G  £(P{ 7))  be  the  point  such  that  hx*  =  max{/ix  :  x  G  £(P('y))}  and  let  h*  =  h/(hx*), 
then  max{h*x  :  x  G  £(P(7))}  =  1  and  the  hyperplane  h*x  =  1 'touches  the  ellipsoid  £(P( 7)) 
at  only  one  point  x*.  It  is  obvious  that 


h*x  <  h*x 0  <  h*x*  =  1  Vx  G  co  j £(Pj),j  G  [1,1V]} . 

This  implies  that  each  ellipsoid  £ (Py)  is  between  the  hyperplanes  h*x  =  1  and  h*x  =  -1  without 
touching  them.  By  Fact  1,  we  have 


1  KQj 
QjK  Qj 


>0,  j  G  [1,1V]. 


(2) 
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By  the  convexity,  we  should  have 

>  0  ■<=>  h*Q(7)/i#  <  1- 
However,  since  the  hyperplane  h*x  =  1  touches  the  ellipsoid  £{P{ 7)),  we  also  have 

KQ{l)K  =  1, 


1  KQ{  7) 

Q(7)fcl  Q(7) 


(3) 


which  contradicts  (3).  Therefore,  we  conclude  that  there  exists  no  xo  €  £(P( 7))  such  that 
zo  $  co  ^£(Pj),j  G  [1,-/V]j.  This  proves  that  £(P(j))  C  co| £{Pj),j  €  [l,iV]j. 

Finally,  we  show  that  LVc{  1)  C  U7er  £  (^(t))-  Suppose  that  a;  G  LVc{  1).  Then  there  exists 
a  7  G  r  such  that  xTP('y)x  <  1.  It  follows  that  x  G  £(P(j))  C  U7er  £(P(t))- 
Combining  the  above  set  inclusion  results,  we  obtain 

LVc{  1)  C  (J  £{P{ 7))  C  co{5(P,),i  G  [1,JV]}  C  LVc(  1). 

7er 

Therefore, 

iv.(i)  =  U  S(P(-,))  =  co{s(Pi),j  e  [i,JV]}. 


Theorem  2  The  function  Vc(x)  is  continuously  differentiable  in  x.  Let  7*  be  an  optimal  7  such 
that  xTP('y*)x  =  min^r  xTP{ j)x,  then 


dVc 

dx 


2P('y*)x. 


Proof.  Let  us  first  establish  a  property  about  the  differentiability  which  will  simplify  the  proof. 


Suppose  that  Vc(x)  is  differentiable  at  x0  with  partial  derivative  ^ 
Since  Vc(kx)  =  k2Vc(x)  for  all  x  G  R.n,  we  have 


X=Xq 


and  let  k  be  given. 


Vc(kx0  4-  Ax)  -  Vc{kx0)  =  k2(Vc{x0  +  Ax/k)-Vc(x0)) 


■  *■((£ 


=  k 


where  |  •  |  can  be  any  norm.  It  follows  that 


dVc 

dx 


X— — Xo  j 
\  T 


j  Ax/k  +  o(\Ax/k\) 
Ax  +  oflAzI), 


X=XQ  j 


dVc 

dx 


=  k 


x=kx  0 


dVc 

dx 


X=XQ 
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In  view  of  tins  equality,  we  only  need  to  consider  those  x  on  the  boundary  of  Lyc(l),  dLyc{l). 
Here  we  use  “ dv  to  denote  both  the  boundary  of  a  set  and  the  partial  derivative. 

Since  the  set  Lyc(  1)  is  convex,  for  each  x0  €  dLyc{  1),  there  exists  a  vector  h0  G  Rlxn  such 
that 

1  =  hoxo  >  hox  Vx  G  Lyc(  1),  (4) 

which  implies  that  Lyc{l)  C  C(h0).  Let  7*  be  an  optimal  7  such  that 

XoPil*)^  =  minxJP(7)x0  =  1. 

7^1 

Since  £{P{ 7*))  C  Lyc{l),  it  follows  that  £(P{ 7*))  C  C(h0)  and 

hoxo  >  hox  Vx  G  £{P{ 7*)). 

By  Fact  1,  the  hyperplane  hox  =  1  is  tangential  to  the  ellipsoid  £(P( 7*))  xo-  Therefore,  such 
a  vector  ho  is  uniquely  determined  by  %o-  Denote  Po  =  P( 7*)-  Combining  the  above  results,  we 
have 

£(P0)  C  LVc(l)  C  £(h0).  (5) 

By  Fact  1,  we  also  have 

x0  =  p-'hl  h0PolK  =  1,  (6) 

and 

hoxo  >  hx 0  V/iT  e£(Pq1)  \  {ho}.  (7) 

Now  we  show  that 

=  2  hi  =  2P0x0. 

From  (5),  it  follows  that  for  all  x  G  dLyc(  1),  Vc(x)  =  1,  hox  <  1  and  xTPox  >  1,  i.e., 
h0x  <  1  =  V?(x)  =  1  <  (xTP0x) 2  Vx  G  dLVc(  1). 

Since  v) (kx)  =  kvj(kx),h0(kx)  =  kh0x  and  {(kx)T P0(kx))  2  =  fc(xTP0x) 2,  we  have 
MM  <  Fc’(fcx)  <  ((A:x)tPo(A:x))2  V*  >  0,  x  G  &LVc(l). 

Since  every  point  in  Rn  can  be  written  as  kx  for  some  k  >  0  and  x  G  dLVc(  1),  we  have 

hox  <  Vc*(x)  <  (xTP0x)i  Vx  G  Rn.  (8) 


£14 

dx 
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Recalling  that  (xqPqXq)  ?  =  1  and  from  (6),  we  have 


d(xTPo%)  2 


dx 


=  Po*o  =  hi 


X=Xq 


Hence, 


((xo  +  Ax)TPo(xo  +  Ax))*  =  l  +  h0Ax  +  o(|Ax|).  (9) 

Recalling  from  (4)  that  hoxo  =  1,  we  have 

h0(x0  +  Ax)  =  l  +  h0Ax.  (10) 

i 

Combining  (8),  (9),  (10)  and  that  Vc2  (x0)  =  1,  we  obtain 

vj(x0  4-  Ax)  =  1  +  h0  Ax  +  o(|Ax|)  =  ^(xo)  +  ho  Ax  +  o(|Ax|), 

which  implies  that  vj  (x)  is  differentiable  at  x  =  x0  and  the  partial  derivative  is  given  by  hj. 
It  follows  that  Vc(x)  is  differentiable  at  x  =  xq  with  the  partial  derivative  given  by 


dVc 

dx 


i 


2  Vc2  (x0)hj  =  2hl  =  2P0x0  =  2P(7*)x0. 


\X~Xq 


In  the  rest  of  the  proof,  we  show  that  dVJdx  is  continuous  in  x.  Since 

=  k 


dVc 

dx 


dVc 


!  X—-IO 


lx=Jfcx0  dx 

it  suffices  to  prove  the  continuity  on  the  surface  dLyc(  1)-  Let  xo  €  <9Lyc(l)  with  ho  and  Po 
defined  as  above.  Then  we  have  hj  =  Po^o  and  hoPiT^o  =  hoxo  —  1.  Consider  v  £  dLyc(  1)- 
Let 

V  2  \  dx  x=v) 

Then  h(x 0)  =  ho  and  by  the  foregoing  proof,  we  have  h(v)v  =  1,  Lyc(l)  C  C{h(v))  and  hence 
£(P0)  C  C(h(v)).  By  Fact  1, 


h(u)P0_1hT(u)  <  1  <=>  hT(v)  £  £(P0  :)  Vu  £  dLVc(  1). 


(11) 


It  follows  that  there  exists  a  positive  number  do  such  that  |h(u)|2  <  do  for  all  v  £  dLyc(l).  Now 
suppose  on  the  contrary  that  h(v)  is  not  continuous  at  v  —  xo  on  the  surface  dLyc  (1) •  Then 
there  exists  a  positive  number  e  such  that  for  any  arbitrarily  small  number  6  >  0,  there  exists  a 
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v  G  B(x 0,5)  n  dLvc{  1)  satisfying  hr(v)  £  B(h0,e).  Note  that  e  is  fixed  and  S  can  be  arbitrarily 
small.  What  we  will  show  next  is  that  the  assumption  of  the  existence  of  such  e  will  cause 

contradiction. 

Prom  above,  we  have 

hoP^h-Q  =  1,  h(v)Po1h(v)T  <1,  h0x0  =  1,  h(v)v  =  1. 

By  Fact  1,  we  know  that 

hoxo  >  hx o  V  hT  G  5(P 3  1 )  \  - 

Then  it  is  clear  that 

sup  hx o  =:  k*  <  1.  (1^) 

/iTe£(V)\S(/io,e) 

Hence  for  all  hr  G  £(P0-1)  \B{h0,e),  hx0  <  k*  <  1.  On  the  other  hand,  for  all  v  G  ff(*o,<5)  0 
dLyc(l),  we  have  h(u)u  =  1  and 

|/i(v)rz;o  —  h(v)v |  <  |/z(z?)|2^  <  dbff- 


Hence 


/i(v)a:o  >  /i(v)v  —  do8  =  1  —  do5 . 


Let  (5  be  chosen  such  that  do$  <  1  —  k* .  Then 


h(v)x o  >  1  -  d0S  >  k*  Vv  G  B(ar0,  *)  0  02V.  (1).  (13) 

By  assumption,  there  exists  a  v  G  B( xo,  5)  H  dLyc(l)  such  that  h  ( v )  G  5(P0  )  \  e)  (note 

that  hT{v)  G  5(P0_1)  is  from  (n))-  Jt  follows  from  (12)  that  h^x°  -  **»  which  contradicts 
(13).  Therefore,  /i(u)  must  be  continuous  at  xq. 

Finally,  we  note  that  the  partial  derivative  is  continuous  at  x  =  0  with  dVc/dx\x=Q  =  0.  □ 

We  next  consider  some  computational  issues  with  regard  to  the  function  Vc{x).  The  function 
Vc(x)  and  an  optimal  7  can  be  computed  with  LMI  toolbox: 


Vc(x) 


mm  a 

7 

s.t. 

a  xT 

.*  Ef=x7 -jQj . 

N 

LTj  =  1>  7j  >  0. 

j~  1 


(14) 
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If  we  only  have  two  ellipsoids,  there  exists  a  more  efficient  way  to  obtain  Vc(x)  through 
computing  the  generalized  eigenvalues  of  certain  matrices.  In  this  case,  we  have 

Vc{x)  =  min  xT(A<5i  +  (1  —  A )Q2)~1x. 

AS  [0,1] 

Denote  a( X,x)  =  xT(A Q\  +  (1  -  A)^)-1®- 

Proposition  1  Assume  that  Q i  —  Q2  is  nonsingular.  For  every  x  G  R”,  the  function  a( X,x) 
is  strictly  convex  in  A  G  [0,1]  and  there  exists  a  unique  A*  G  [0,1]  such  that  a(\*,x)  = 
min^cfcg]  a(A,  x).  Moreover,  A*  is  a  continuous  function  of  x. 

Remark  1  The  assumption  that  Q\  —  Q2  is  nonsingular  is  without  loss  of  generality.  For  the 
case  where  n  =  2,  det(<2i  -  Q2)  =  0  implies  that  either  Q\  >  Q2  or  Q\  <  Q2.  If  Q\  >  Q2,  then 
Pi  <  P2  and  Vc(x)  =  Vi(x),  which  is  not  meaningful. 

Proof  of  Proposition  1.  The  first  and  the  second  partial  derivatives  of  a(A,x)  with  respect 
to  A  are 


da 

d\ 


=  xr(XQl  +  (1  -  X)Q2)-1(Q2  -  Qi){XQi  +  (1  -  X)Q2)~1x 


and 

=  2xT(A<2i  +  (1  -  X)Q2)~\Q2  -  Qi)(XQi  +  (1  -  X)Q2)~\Q2  -  Qi)(XQ1  +  (1  -  A)<52)_1x. 

oXz 

Since  (AQi  +  (l -A)^)-1  >  0  for  all  A  G  [0,1]  and  Q2-Q\  is  nonsingular,  we  have  d2a/dX2  >  0 
for  all  A  G  [0, 1]  and  x  G  Rn.  This  shows  that  a(A,  x)  is  strictly  convex  in  A  and  establishes  the 
uniqueness  of  A*  G  [0, 1]  such  that  a(X*,x)  =  minAe[0;i]  a(A,  x).  Denote  the  function  of  A*  in  x 
as  A*(x).  Consider  xq  G  Rn.  If  A*(x0)  G  (0, 1),  then  for  x  in  a  neighborhood  of  x0,  a(X,x)  has 
a  unique  minimum  at  A*  G  (0, 1)  satisfying 

=  x'r(X*Qi  +  (1  -  X*)Q2)~1(Q2  -  Qi)(X*Qi  +  (1-  X *)Q2)~lx  =  0. 

Since  ^  0,  by  implicit  function  theorem,  A*(x)  is  continuously  differentiable  at  xq.  For  those 
x0  such  that  X*(x0)  =  0  (or  1),  we  have  two  possibilities 

1.  da/dA|A=o,x=®0  =  0.  Then  as  x  varies  in  a  neighborhood  of  xq,  da/dX  =  0  occurs  in  a 
neighborhood  of  A  =  0.  In  this  neighborhood  of  xo,  if  dajdX  =  0  for  some  A  <  0,  then  we 
must  have  X*(x)  =  0  and,  if  da/dX  —  0  for  some  A  >  0,  then  X*(x)  >  0  and  must  be  in  a 
neighborhood  of  A  =  0.  These  show  the  continuity  of  A*  ( x )  for  this  case. 


da 

dX 


A=A* 
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2.  da/d A|a=o,x=i0  >  Then  we  have  da/dMx=o  >  0  for  a11  x  in  a  neighborhood  of  ar0.  By 
convexity,  we  have  A*  (x)  =  0  for  all  x  in  this  neighborhood  of  xq  ,  which  also  confirms  the 
continuity  of  A*(x).  D 

Let  7*  =  (A*,  1  -  A*).  By  Proposition  1,  7*  is  the  unique  value  such  that  xT{P('y*))x  =  Vc(x) 
and  it  depends  on  x  continuously.  This  will  be  useful  in  Section  5  to  our  construction  of 
continuous  feedback  laws  from  two  given  feedback  laws. 

Here  we  provide  a  method  for  computing  the  value  A  such  that  da/ d\  =  0  for  a  given  x.  By 
Proposition  1,  this  will  give  us  A*  and  7*. 


Proposition  2  Let  x  G  Rn  and  Qi,Q2  >  0  be  given.  Assume  that  Qi  Q2  is  nonsingular. 
Let  U  G  Rnxn  be  such  that  UTU  =  I  and  UTxxTU  =  diag{c,  0,  •  •  • , 0}.  Let  Q\  =  UrQiU,  Q2  = 
UTQ2U  and  partition  Q\  and  Q2  a>s 


Qi  =  [<?i  Q12],  Q2  =  [Q2  Q22],  Qi,Q2  G  R' 


nxl 


Then  da/dX  =  0  at  X  G  [0, 1]  if  and  only  if 
det 


A(<5i2  —  Q22)  +  Q22  Ql~Q2 

0(n-l)x(n-l)  X(Ql2  ~  Qh)T  +  Q22 


0. 


(15) 


The  proof  of  Proposition  2  can  be  found  in  Appendix  A.  All  the  A’s  satisfying  (15)  can  be 
obtained  by  computing  the  generalized  eigenvalues  of  the  matrix  pair  (X,  Y )  where 


Q22  Qi  —  Q2 
0(n-l)x(n-l)  Q22 

By  Propositions  1  and  2,  (X,Y)  has  at  most  one  generalized  eigenvalue  in  [0, 1].  If  there  is  none 
in  [0,1],  then  A*  =  0  or  1.  Experience  shows  that  computing  the  matrices  X  and  Y  and  their 
generalized  eigenvalues  requires  much  less  time  than  solving  the  LMI  problem  (14). 

Fig.  1  illustrates  a  two  dimensional  level  set  which  is  the  convex  hull  of  three  ellipsoids.  Fig.  2 
plots  the  values  of  7*  =  (7^,72,73)  as  x  varies  along  the  boundary  of  LVc(  1)  in  counterclockwise 
direction,  where  the  abscissa  is  the  angle  of  x  (from  0  to  7 r).  From  Fig.  1,  we  see  that  parts  of 
dLVc(  1)  overlap  with  segments  of  S(Pi),i  =  1,2,3.  The  overlapped  segments  correspond  to  the 
intervals  in  Fig.  2  where  7*  =  1.  Fig.  3  illustrates  a  three  dimensional  level  set.  It  is  also  the 
convex  hull  of  three  ellipsoids. 


*§12  —  Q22  0n*n 
0(n-l)x(n-l)  Q\2  -  Q22 
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Figure  1:  A  two  dimensional  level  set  Lyc  (1). 


Figure  2:  7*  along  the  boundary  of  Lyc(  1)- 

3  Invariant  sets  under  a  given  saturated  linear  feedback 

This  section  will  also  include  some  results  on  a  class  of  saturation-like  nonlinearities. 

Consider  the  open-loop  system 

x  =  Ax  +  Bu,  xeRn,  u  e  Rm,  (16) 

where  u  is  the  output  of  saturating  actuators  and  is  assumed  to  satisfy  the  bound  Moo  <  1. 
The  state  constraint  is  represented  by  a  convex  set  fl0,  which  contains  the  origin  in  its  interior. 
It  is  required  that  the  system  operate  in  for  all  t  >  0.  Suppose  that  we  have  a  stabilizing 
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Figure  3:  A  three  dimensional  level  set  Lyc{  1)- 

feedback  law  u  =  sat  (Fx),  under  which  the  closed-loop  system  is 

x  =  Ax  +  Bsa.t(Fx).  (17) 

Since  is  generally  not  an  invariant  set,  we  would  like  to  determine  a  maximal  subset  of 
such  that,  for  any  initial  state  x0  in  this  subset,  the  state  trajectory  of  (17)  will  stay  in 
it  and  converge  to  the  origin.  Because  of  the  intrinsic  difficulty  involved  in  determining  the 
maximal  invariant  set  inside  flo,  alternative  problems  have  been  formulated  such  as  determining 
the  invariance  of  ellipsoids  and  searching  for  the  largest  invariant  ellipsoid  inside  {lo¬ 
in  [11],  we  derived  a  sufficient  condition  for  checking  the  invariance  of  a  given  ellipsoid.  This 
condition  turns  but  to  be  also  necessary  for  single  input  systems  [9].  We  need  some  notation  to 
state  the  set  invariance  condition  of  [11].  Let  V  be  the  set  of  m  x  m  diagonal  matrices  whose 
diagonal  elements  are  either  1  or  0.  There  are  2m  elements  in  V.  Suppose  that  each  element 
of  V  is  labeled  as  A,  i  =  1,2,  •  •  • ,  2m.  Then,  V  =  {d{  :  i  £  [1, 2m]}.  Denote  D~  =  I  -  A- 
Clearly,  D~  is  also  an  element  of  D  if  A  G  V.  Given  two  vectors,  u,v  £  Rm, 

[DlU  +  D~v.  i  £  [1, 2m]} 

is  the  set  of  vectors  formed  by  choosing  some  elements  from  u  and  the  rest  from  v.  Given  two 
matrices  F,H  £  Rmx”, 

[DiF  +  DiH:  i  £  [l,2m]} 

is  the  set  of  matrices  formed  by  choosing  some  rows  from  F  and  the  rest  from  H. 
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Given  a  positive  definite  matrix  P,  let  V  (x)  =  xrPx.  The  ellipsoid  £(P,p)  is  said  to  be 
contractively  invariant  if 

V(x)  =  2xTP(Ax  +  Bsatk(Fx))  <  0  (18) 

for  all  x  £  £(P,p)  \  {0}.  The  invariance  of  £(P,p)  can  be  defined  by  replacing  “<”  in  (18)  with 
Clearly,  if  £(P,p)  is  contractively  invariant,  then  for  every  initial  state  xq  £  £(P,p),  the 
state  trajectory  will  converge  to  the  origin  and  £(P,  p)  is  in  the  domain  of  attraction. 

Proposition  3  [11,  8]  Given  an  ellipsoid  £(P,p),  if  there  exists  an  H  £  Rmx”  such  that 

(A  +  B(DiF  +  D£H))TP  +  P(A  +  B(DiF  +  D£H))  <  (<)0  Vie[l,2m],  (19) 

and  £(P,p)  C  C{H),  then  £(P,p)  is  a  (contractively)  invariant  set. 

The  condition  in  Proposition  3  is  easy  to  check  with  LMI  method.  To  impose  the  state 
constraint,  we  only  need  to  require  that  £(P,p)  C  fio-  In  the  case  that  Go  is  a  symmetric 
polytope,  there  exists  a  matrix  Go  G  R£xn  for  some  integer  l  such  that  flo  =  £{Go).  In  light 
of  Fact  1,  the  requirement  that  £(P,p)  C  flo  can  be  easily  transformed  into  LMIs.  In  [11,  8], 
we  also  developed  LMI  methods  for  choosing  the  largest  invariant  ellipsoid  with  respect  to  some 
shape  reference  set,  where  the  matrix  P  was  taken  as  an  optimizing  parameter.  The  shape 
reference  set  could  be  a  polygon  or  a  fixed  ellipsoid.  It  could  also  be  a  single  point  xq  €  Rn. 
In  this  case,  the  largest  invariant  ellipsoid  inside  fio  is  the  one  that  includes  ax o  with  the 
maximal  a  >  0.  By  choosing  different  xo,  say,  Xq j,j  £  [1 ,  iV] ,  we  can  obtain  N  optimized 
invariant  ellipsoids  £{Pj,  pj)  C  Clo,j  £  [1,  N].  It  is  easy  to  see  that  the  union  of  these  ellipsoids, 
U *j=\£{Pji Pj)->  is  also  an  invariant  set  inside  f2o-  But  this  union  does  not  necessarily  include 
the  convex  hull  of  xq j,j  £  [1 ,  Ar] .  What  is  desired  here  is  that  the  convex  hull  of  the  ellipsoids, 
co {£(Pj,pj),  j  €  [1,  IV]},  is  also  an  invariant  set. 

For  simplicity  and  without  loss  of  generality,  we  will  consider  a  group  of  invariant  ellipsoids 
£(Pj,pj),j  £  [1,  TV],  with  pj  =  1.  The  following  theorem  says  that  if  each  £(Pj)  satisfies  the 
condition  of  Proposition  3,  then  their  convex  hull,  co {£(Pj),j  £  [1,7V]},  is  also  invariant. 

Theorem  3  Given  a  group  of  ellipsoids  £(Pj),j  £  [1,7V].  If  there  exist  matrices  Hj,j  £  [1,7V] 
such  that 

(A  +  B{DiF  +  D£Hj)YPj  +Pj(A  +  B(DiF  +  Df  Hj))  <0  Vt  €  [1, 2m],  j  £  [1,7V],  (20) 
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and  S(Pj)  C  £(Hj),  j  £  [1,JV],  then  co {£{Pj),j  £  [1,  AT]}  is  an  invariant  set.  If  “<”  holds  for 
each  of  the  above  inequalities,  then  for  every  initial  state  xq  6  co{£  (Pj),j  €  [l,iV]},  the  state 
trajectory  will  converge  to  the  origin. 

Proof.  Let  Qj  —  P~l  and  Zj  =  HjQj.  The  inequalities  in  (20)  are  equivalent  to 
Qj{A  -1-  BDiFf  +  [A  +  BDiF)Qj  +  Z]DrBT  +  BD~Zj  <0  Vi  £  [1, 2m],  j  £  [1,  N].  (21) 
The  condition  £{Pj)  C  £(#,),  j  £  [1,  AT],  can  be  written  as 

l  5‘1>0,  i€[l,SI,  *e[l,m],  (22) 

.  Zjk  **3  . 

where  Zjk  is  the  kth  row  of  the  matrix  Zj.  Consider  xo  £  co{£  (Pj),j  €  [1,  N]}.  There  exists  Xj  £ 

£(Pj)  and  jj  >  0 ,j  £  [1,  TV],  such  that  71+72  d - h7 n  =  1  and  xo  =  71X1  +72^2  H - Let 

Q  =  JiQi+12Q2+"'+'YnQn  andP  =  Q~l.  Then  by  Theorem  1,  £ (P)  C  co {£(Pj),j  €  [1,N]}. 
Prom  Xj  £  £(Pj),  we  have  xJPjXj  <  1,  which  is  equivalent  to 

I  *j  ]> 0,  je 

By  the  convexity,  we  have 

which  implies  that  XqPx 0  <  1  and  xo  £  £(P)- 

Let  Z  =  71.Z1  +72^2  H - b7 n%n,  and  z*  be  the  A:th  row  of  Z ,  then  by  (21),  (22)  and  the 

convexity,  we  have 

Q(A  +  BDiFf  +  (A  +  BDiF)Q  +  ZTD~BT  +  BD~Z  <  0  Vi  €  [1, 2m],  (23) 

and 

t  n  -°>  (24) 

Let  if  =  ZQ_1  =  ZP.  The  inequalities  in  (23)  and  (24)  can  be  rewritten  as 

(A  +  B(DiF  +  D~ H))rP  +  P(A  +  B(D{F  +  DrH))  <0,  i  £  [1, 2m],  (25) 

and 

pXhl  hkpSk  >0,  k  £  [1,  m]  ^  £(P)c£(H).  (26) 
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The  inequalities  in  (25)  and  the  condition  (26)  jointly  show  that  £{P )  is  an  invariant  set  by 
Proposition  3.  Hence  a  trajectory  starting  from  xq  will  stay  inside  of  £(P),  which  is  a  subset  of 
co{£(Pj) :  j  G  [1,N]}.  Since  xo  is  an  arbitrary  point  inside  co {£{Pj)  :  j  €  [1,  A?']},  it  follows 
that  this  convex  hull  is  an  invariant  set.  If  “<”  holds  for  all  the  inequalities  in  (20),  then  we 
also  have  “<”  in  (25),  which  guarantees  that  the  trajectory  starting  form  xq  will  converge  to 
the  origin.  D 

For  single  input  systems,  it  was  shown  in  [9]  that  the  set  invariance  condition  in  Proposition  3 
is  also  necessary.  Hence  we  have 

Corollary  1  Suppose  that  (17)  is  a  single  input  system.  Given  a  group  of  ellipsoids  £(Pj),j  G 
[1,N].  If  each  ellipsoid  £{Pj)  is  (contractively)  invariant,  then  co {£{Pj),j  €  [1,  N]}  is  a  (con- 
tractively)  invariant  set. 

Actually,  Corollary  1  can  be  extended  to  a  more  general  class  of  saturation-like  functions. 

Theorem  4  Let  <f>(s)  :  R  »-f  R.  be  a  continuous  function  such  that  <^(0)  =  0  and  |<^(s)|  <  |s|. 
Assume  that  for  s  >  0,  </>(.s)  >  0  is  concave  and  for  s  <  0,  </>(s)  <  0  is  convex.  Consider  a  single 
input  system  (16)  with  u  =  <f>(Fx).  The  closed-loop  system  is 

x  =  Ax  +  B<f>{Fx).  (27) 

Given  a  group  of  ellipsoids  £ (Pj),  j  G  [1,  AT].  Suppose  that 

(A  +  BFYPj  +  Pj  (A  +  BF)  <  0(<  0),  j  G  [1,  AT],  (28) 

If  each  ellipsoid  £{Pj)  is  (contractively)  invariant  for  (27),  then  co {£{Pj),j  €  [1,  AT]}  is  a 
(contractively)  invariant  set. 

Note  that  when  f(s)  =  sat(s),  the  condition  (28)  is  necessary  for  the  (contractive)  invariance 
of  each  £  {Pj).  Hence  it  is  not  an  additional  condition  as  compared  with  Corollary  1.  Fig.  4 
illustrates  a  few  functions  that  satisfy  the  constraint  for  <f>(s)  in  Theorem  4.  The  restriction 
|^)|  <  |s|  can  be  extended  to  |<£(s)|  <  a|s|  for  any  a  >  0.  If  we  have  a  ^  1,  then  we  can 
replace  B  with  aB  and  f(s)  with  <f>(s)/a. 
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Figure  4:  A  class  of  saturation-like  functions. 


Proof  of  Theorem  4.  Recall  from  Theorem  1  that  co {£{Pj),j  G  [1,1V]}  =  Lye(l).  We  prove 
the  invariance  of  Lyc(l)  instead.  It  suffices  to  show  that 

Vc(x)  =  (f^)  V*  +  B*(Fx))  <  0 

for  all  x  €  dL\re  (1).  For  contractive  invariance,  we  can  show  that  Vc(x)  <  0  for  all  x  £ 
dLvc{p),p  G  (0, 1],  following  a  same  procedure. 

Now  we  consider  an  arbitrary  xq  £  dLyc(l).  For  simplicity,  assume  that  Fx o  >  0  (the 
proof  for  Fx o  <  0  is  similar).  If  xo  G  d£(Pj)  for  some  j  G  [1,1V],  then  =  2PjXo  and 

Vc(x)  =  Vj(x)  <  0  follows  from  the  invariance  of  £(Pj).  Hence  we  assume  that  x0  $  d£(Pj) 
for  any  j.  Then  there  exist  an  integer  IVo  <  N,  some  numbers  otj  G  (0, 1)  and  vectors  Xj  G 
£{Pj),j  G  [1 ,1V0],  such  that 

No  No 

'y  'j  aj  =  1,  XO  =  ^  y  OCjXj. 

3= 1  3= 1 

(Here  we  have  assumed  for  simplicity  that  xq  is  only  related  to  the  first  Nq  ellipsoids.  Otherwise, 
the  ellipsoids  can  be  reordered  to  meet  this  assumption.)  Let  ho  =  \  >  then  by 

Theorem  2,  h0x0  =  x^P{ 7*)x0  =  1.  It  follows  that  the  hyperplane  h0x  =  1  is  tangential  to 
the  convex  set  LVc(  1)  at  x  =  x0.  Hence  Lyc(  1)  lies  between  h0x  =  1  and  h0x  =  -1,  i.e., 
Lyc(  1)  C  £{ho).  Therefore, 

£{Pj)  C  C{ho)  VjG[l,lVo],  (29) 
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and 


1  =  h0xo  >  h0Xj  Vj£  [l,JVo]. 

We  claim  that  hQxj  =  1  for  all  j  €  [1,  iVo]-  Suppose  on  the  contrary  that  h0Xj  <  1  for  some  j, 
say,  hoxi  <  1,  then 

N0  No  No 

1  =  ho^o  =  <*ihoXi  4-  ctjhoXj  <  a\hoX\  +  ao  <  X)  ai  = 
j- 2  3= 2  j= 1 

which  is  a  contradiction.  Because  of  (29)  and  Xj  6  £{Pj),  the  equality  hoXj  =  1  implies  that 
£{Pj)  touches  the  hyperplane  hox  =  1  at  x  =  Xj.  Hence  the  hyperplane  Hqx  —  1  is  tangential 
to  £(Pj)  at  Xj  for  every  j  G  [1,  No].  It  follows  from  Fact  1  that 

K  =  PjXj  Vy  6  [1,  IVo]- 

Let  Vj(x)  —  xTPjX.  Since  each  ellipsoid  £{Pj)  is  invariant,  we  have 

Vj(xj)  =  2xjPj(Axj  +  B(f>(Fxj ))  =  2ho(Axj  +  B<j>{Fxj ))  <0,  j  G  [1,  JVo]-  (30) 
We  need  to  show  that 

Vc(x0)  =  2h0(Ax0  +  B(j>{Fx 0))  <  0.  (31) 

Because  of  (28),  we  have 

2xJPj(Axj  +  BFxj )  =  2h0(Axj  +  BFxj )  <0  Vj  €  [l,iVo]. 

Hence,  for  all  x  6  co{rcx, X2, , xn0 }, 

2h0(Ax  +  BFx)  <  0.  (32) 

We  first  assume  that  Fxj  >  0  for  all  j  £  [l,IVoj.  In  this  case,  Fx  >  0  for  all  x  6 
co{a:i, X2i ••• , xn0}-  If  B  >  0,  then 

Fc(x0)  =  2ho{Axo  +  B<j>{Fx0))  <  2h0(Ax0  +  BFx0 )  <  0, 

noticing  that,  by  the  assumption  that  Fx o  >  0  and  by  the  property  of  the  function  0(s),  we 
have  <j){Fxo)  <  Fxq.  If  hoB  <  0,  then  by  the  property  of  <f>(s),  ho  Ax  +  hoB<p{Fx)  is  a  convex 
function  for  x  6  co{xi,x2,  ■  •  •  ,xat0}-  Hence  we  also  have  (31)  by  (30). 
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If  Fxj  >  0  does  not  hold  for  all  j  G  [l,iV0],-  then  we  can  get  an  intersection  of  the  set 
co{a:i,rr2,***-.^o}  with  the  half  space  Fx  >  0.  This  intersection  is  also  a  polygon  and  can 
be  denoted  as  cso{yi, yNi }•  Since  Fx o  >  0,  we  have  xo  G  co{yi,  y2,  •  •  • , yjvx }•  Some  y/s 
belong  to  {®ira;2,'* '•»*«<»  }i  others  are  not.  For  those  yj  {xi  :  i  G  [1, No)},  we  must  have 
Fyj  =  0  and  y3  €  co{^j  :  i  G  [1,  No]}.  It  follows  from  (32)  that  ho(Ayj  +  BFyj )  <  0.  Since 
0(0)  =  0,  for  those  y/s  such  that  Fyj  =  0,  we  have 

Vc{y3)  =  2ho(Ayj  +  B<f>(Fyj))  =  2h0(Ayj  +  BFVj)  <  0. 


In  summary,  we  have 

Vc(yj)  =  2ho(Ayj  +  BftFyj))  <0  V j  G  [1,  JVi].  (33) 

Because  of  this,  we  can  work  on  the  set  co{yi ,  y2 ,  •  •  • ,  VNi }  instead  of  co{ri ,  X2,  •  •  • »  Since 

Fyj  >  0  for  all  j  G  [1,  Ni],  same  arguments  can  be  used  to  prove  (31)  by  using  (33)  instead  of 
(30).  D 

4  Controlled  invariant  sets 

In  this  section,  we  investigate  the  possibility  that  a  level  set  can  be  made  invariant  with  controls 
delivered  by  the  saturating  actuators.  Given  a  positive  definite  function  V(x),  suppose  that 
the  level  set  Lv(  1)  is  bounded  and  V(kx)  =  k2V{x).  A  level  set  Lv(p)  is  said  to  be  controlled 
contractively  invariant  if  for  every  x  G  Ly(p)  \  {0},  there  exists  a  u  G  R771,  |u|oo  5:  1>  such  that 

V(x,u)  =  (j^y  (Ax  +  Bu)  <  0. 

The  controlled  invariance  can  be  defined  by  replacing  “<”  with  “<”.  Since  V(kx)  =  k2V(x),  we 

have  4^1  =  k  4^1  .  Hence  if  Ly{p)  is  controlled  (contractively)  invariant,  then  Lv(pi) 

\x=kxo  ax  la:=a:o 

is  for  all  pi  <  p.  Therefore,  to  determine  the  controlled  (contractive)  invariance  of  Ly(p),  it 
suffices  to  check  all  the  points  in  dL\r{p )•  For  the  composite  quadratic  Lyapunov  function  Vc(x) 
defined  in  (1),  we  have 

Theorem  5  Suppose  that  each  ' of  the  ellipsoids  £(Pj),j  G  [1 ,  AT],  is  controlled  (contractively) 
invariant,  then  Lyc(l)  is  controlled  (contractively)  invariant. 
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Proof.  We  only  prove  controlled  invariance.  The  controlled  contractively  invariance  can  be 
shown  similarly. 

Denote  Vj(x)  =  xTPjX.  The  condition  implies  that  for  all  x  G  d£(Pj),  there  exists  a  u  G  Rm, 
Moo  <  1,  such  that 

Vj  (x,  u)  =  2xTPj  {Ax  +  Bu)  <  0.  (34) 

Now  we  consider  an  arbitrary  xo  G  dLy(l).  If  xo  G  d£{Pj)  for  some  j  G  [1,  N],  then  = 

2PjXo  and  Vc{x,  u)  =  Vj{x,u )  <  0  follows  from  (34).  Hence  we  assume  that  xo  ^  d£(Pj )  for 
any  j.  Then,  similar  to  the  proof  of  Theorem  4,  there  exists  an  integer  No  <  N,  some  numbers 
Ckj  G  (0, 1)  and  vectors  Xj  G  £{Pj),j  G  [l,lVb],  such  that 

No  No 

)  ]  ^  oijXj. 

j=i  j= l 


Letting  ho  =  5  ^  ^  ,  we  have 


hTo=PjXj  Vje[l,No], 


and  the  hyperplane  Hqx  =  1  is  tangential  to  each  £{Pj)  at  Xj.  By  assumption,  there  exists  a 
uj  G  Rm,  |uj|oo  <  1,  such  that 

Vj(xj, Uj)  =  2x'jPj{Axj  +  Buj)  <  0, 

i.e.,  2ho{Axj  +  Buj )  <  0,  for  all  j  G  [1,7V0].  Let  uq  =  ajuj-  Then  |uo|oo  <  1  and  by  the 
convexity,  we  have 

Vc(x0,uo)  =  2ho(Axo  +  Buq)  <  0. 

Since  xq  is  an  arbitrary  point  in  dLyc{  1),  this  implies  that  the  level  set  Lyc{  1)  is  controlled 
invariant.  □ 

If  a  level  set  Lyc{l)  is  controlled  contractively  invariant,  a  simple  feedback  law  to  make  it 
contractively  invariant  is 

Ui  =  -sign  >  *  €  [1  ,m],  (35) 

where  b{  is  the  ith  column  of  B.  However,  due  to  the  discontinuity  of  the  sign  function,  the 
closed-loop  system  under  this  control  may  be  not  well  behaved.  For  instance,  the  closed-loop 
differential  equation  may  have  no  solution.  It  can  be  shown  with  methods  in  [8],  Chapter  11,  that 
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there  exists  a  positive  number  k  such  that  Lyc(  1)  is  contractively  invariant  under  the  saturated 
linear  feedback  law 


This  control  is  continuous  in  x  since  both  sat(*)  and  ^  are  continuous.  The  value  of  k  may  be 
however  difficult  to  determine.  In  the  next  section,  we  will  provide  a  method  for  constructing  a 
controller  from  a  group  of  saturated  linear  feedback  laws. 

5  Construction  of  continuous  feedback  laws 

Suppose  that  we  have  a  group  of  ellipsoids  £{Pj),j  €  [1,JV],  each  of  them  (contractively)  in¬ 
variant  under  a  corresponding  saturated  linear  feedback  u  =  sat {Fjx).  It  was  shown  in  [13,  8] 
that  a  switching  feedback  law  can  be  constructed  such  that  the  union  U jLi£(Pj)  is  invariant. 
In  this  section,  we  would  like  to  construct  a  continuous  feedback  law  from  these  Fj’ s  such  that 
the  convex  hull  of  the  ellipsoids,  co {£(Pj)  :  j  €  [1,N]}  =  Lyc{  1),  is  invariant. 

Theorem  6  Given  ellipsoids  £{Pj)  and  feedback  matrices  Fj  €  RmXn,  j  €  [1,N].  Suppose  that 
there  exist  Hj  £  Rmxn  such  that  £(Pj)  C  £(Hj)  and 

(A  +  B{DiFj  +  DTH^Pj  +  Pj(A  +  B(DiFj  +  Dr  Hi))  <  0(<  0)  (36) 

for  all  i  £  [1, 2m]  and  j  £  [1,  N].  Let  Qj  =  Pf1,  Yj  =  FjQj.  Let  *y*(x)  be  such  that  xTP( y*)x  = 
Vc(x ).  Suppose  that  the  vector  function  7*( x )  is  continuous  in  x.  Define  F(j)  :=  Y^Q  1(7'); 
where  ^ 

y(i)  =  T,'hYi’  = 

j=i  i= i 

Then  u  =  s&t(F(y*(x))x)  is  a  continuous  feedback  law  and  LVc(  1)  is  (contractively)  invariant 
under  the  feedback  u  =  sat(F'('y*(x))x). 

Proof.  We  only  prove  the  invariance  of  Lyc(l).  The  contractive  invariance  follows  from  similar 
arguments.  Let  Zj  =  HjQj.  Denote  Z( 7)  =  EjLil 'jZj  and  H( 7)  =  Z{y)Q~1(k'r).  We  see  that 
(36)  can  be  rewritten  as 

QjAT  +  AQj  +  (AY;  +  DrZj)YBr  +  B(A^  +  A7 2 3)  <  0 
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for  all  i  G  [l,2m]  and  j  6  [1,  N].  It  follows  from  the  convexity  that  £(P( 7))  C  C(H( 7))  (see  the 
proof  of  Theorem  3,  equation  (26),  where  the  dependence  on  7  is  suppressed)  and 


Q(7)AT  +  Q(7)AT  +  (DiYfr)  +  D-Z(7)))tBt  -f  B(DiY( 7)  +  D~ Z{7)))  <  0 


for  all  i  G  [1, 2m]  and  7  G  T.  The  above  inequality  is  equivalent  to 

(.4  +  B(DiF(j)  +  Dt~ H(7)))tP(7)  4-  Pfr)(A  +  B(DiF( 7)  +  D~H{ 7)))  <0  Vi  6  [1, 2“]. 

By  Proposition  3,  this  inequality  along  with  £(P(7))  G  £(ff( 7))  shows  that  £{P(7))  is  invariant 
under  the  control  of  u  =  sat(f?(7)a:),  i.e., 

2xtP(7)  (Ax  +  Bsat(F(7)x))  <  0  VrG£(P( 7)).  (37) 


For  an  arbitrary  xq  G  dLyc  (1),  let  70  =  7* (ro)-  Then  XqP(jo)xq  =  i-e.,  %o  G  d£{P{ 7o))» 

and  from  Theorem  2, 

ayc| 


=  2P  (70)2:0, 


£=£{) 


It  follows  from  (37)  that 

Vc{xo)  =  2xoP(7o)(-Aa:o  +  Bsat(F(7o)a:o)))  <  0. 

This  shows  that  Lvc{  1)  is  invariant  under  the  control  u  =  sat (F(j*(x))x).  □ 

For  the  case  where  N  —  2  and  Qi  -  Q2  is  nonsingular,  7*  (2:)  is  continuous  by  Proposition  1 
and  can  be  computed  with  Proposition  2. 

Example.  Consider  system  (16)  with 

A  = 

We  have  designed  two  feedback  matrices 

Fi  =  [  0.9471  1.6000  ],  F2  =  [  -0.1600  1.6000  ], 
along  with  two  ellipsoids,  £{P\)  and  £(P2),  where 

Pi  = 


"  0 

-0.5  ’ 

,  B  = 

0 

1 

1.5 

7 

-1 

1.6245 

-1.5364  ' 

,  P2  = 

5.9393 

-0.2561  ‘ 

-1.5364 

15.3639 

-0.2561 

2.5601 
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The  matrices  Pi  and  Pi  are  designed  such  that  the  value  ai  is  maximized,  where  orj  q  j  6  & C^i) 
and  Fi(a:)  =  xrP\x  has  a  guaranteed  convergence  rate  inside  £(Pi)  under  u  =  sat(Fi:r).  The 
matrices  P2  and  F2  are  designed  such  that  the  value  0:2  is  maximized,  where  0:2  ^  €  ^(^2) 

and  V2  {x)  =  xTp2X  has  a  guaranteed  convergence  rate  inside  £(P2)  under  u  =  sat(p2^)  (see 
[10,  8]  for  the  detailed  design  method).  In  Fig.  5,  the  boundaries  of  the  two  ellipsoids  are  plotted 


Figure  5:  The  convex  hull  of  two  ellipsoids. 

in  solid  curves.  The  dotted  curves  are  the  boundaries  of  S(P( 7))  as  7  varies  in  the  set  T.  The 
shape  of  Lyc(  1)  =  U7er  £(-P(t))  can  be  seen  from  these  dotted  curves.  It  can  be  verified  that 
Qi  —  Q2  —  ~  P2”1  is  nonsingular.  So  we  can  use  the  method  in  Proposition  2  to  compute 

the  function  7*(x),  which  is  guaranteed  to  be  continuous  by  Proposition  1.  Simulation  is  carried 
out  under  the  feedback  law  u  =  sat(P(7*(a;))a:).  In  Fig.  6,  a  trajectory  starting  from  dLVc(l)  is 
plotted.  Fig.  7  plots  the  control  signal  u(t)  (in  solid  curve)  and  the  composite  quadratic  function 
Vc(x(t ))  (in  dashed  curve). 

6  Conclusions 

We  introduced  a  composite  quadratic  function  for  analysis  and  design  of  linear  systems  with 
input  and  state  constraint.  We  have  shown  that  this  function  is  continuously  differentiable  and 
its  level  set  is  the  convex  hull  of  a  group  of  ellipsoids.  Using  these  results,  we  studied  some  set 
invariance  properties  of  linear  systems  with  input  saturation  or  saturation-like  nonlinearities. 
In  particular,  we  showed  that  if  every  ellipsoid  in  a  group  is  invariant  under  a  saturated  (or 
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Figure  6:  A  trajectory  and  the  invariant  set  Lyc(l). 


Figure  7:  The  control  signal  u(t)  and  the  Lyapunov  function  T4(a:(t)). 

saturated-like)  feedback,  then  they  convex  hull  is  also  invariant.  Similar  results  on  controlled 
invariance  have  also  been  established.  We  also  proposed  a  method  to  construct  a  continuous 
feedback  law  based  on  a  group  of  saturated  linear  feedback  laws  to  make  the  convex  hull  of  a 
group  of  ellipsoids  invariant.  The  composite  quadratic  function  is  relatively  easier  to  handle  than 
a  general  nonlinear  Lyapunov  function  and  we  expect  to  use  it  to  study  more  general  nonlinear 
systems. 
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A  Proof  of  Proposition  2 


In  the  proof,  we  will  use  the  following  algebraic  fact.  Suppose  that  X\ ,  X4  and 
square  matrices.  If  X\  is  nonsingular,  then 


Xi  X2 
X3  X4 


are 


det 


Xi  x2 

X3  X 4 


=  det(Xi)  det(X4  -  X3X{1X2), 


eind  if  X4  is  nonsingular,  then 


det 


Xi  X2 
X3  X4 


=  det(X4)  det(Xi  -  X2X^X3). 


(38) 


(39) 


Let  Q( A)  6  Rnxn  be  a  matrix  function.  Suppose  that  Q( A)  is  nonsingular,  then 

=  (40) 

In  what  follows,  we  use  I  to  denote  the  n  x  n  unit  matrix  and  0  to  denote  a  zero  matrix  of 

appropriate  dimension.  For  simplicity,  we  use  Q( A)  to  denote  A Q\  +  (1  —  \)Q2. 

If  a(X,x)  =  Vc{x)  and  A*  6  (0, 1),  then  we  must  have  =  0.  From  (40),  we  have 

i  A — A* 


*TQ-x(A*)(Qi  -  Q2)Q-\\*)x  =  0, 


which  can  be  written  as 

det  (l  -xTQ~1(X*){Q1  -  Q2)Q_1( A*)x)  =  1. 
By  applying  (38)  and  (39),  we  obtain  a  sequence  of  equivalent  relations: 


det 


det 


det 


1  0 

0  (Q1-Q2)-1 


1  ^Q-^A*) 

Q-HA*)*  (Qi  -  Q2)_1 


det(Qi  -  Q2)  1 


xT  0 
0  I 


t 

q~H  y) 

0  Q- 

t 


>0(A*)][“  ^])  =  det(Q,  - 


■  Q{  A*) 

0 

'  0  I  ' 

‘1  0 

xT  0 

1  —  flpf 

■  Q(  A*) 

0 

0 

W)  _ 

x  0 

0  {Qx-Qi) 

[  0  / 

1  —  uct 

0 

QO*) 

t 


det 


'  Q(y)  Q1-Q2' 

■  Q{  A*) 

0 

xxT  Q{\*) 

— *  uc  1 

0 

Q( y) . 
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Multiplying  the  matrices  on  both  sides  from  left  with 
we  obtain 


UT  0 
0  Ur 


and  from  right  with 


U  0 
0  U  ’ 


det 


Q2  +  A*(Qi-Q2) 

c  0 
0  On— 1 


Q\  -  Qi 

Q2  +  y(Qi-Q2) 


det 


Q2  +  A*(<2i  —  Q2)  Q1  —  Q2 

0  Q2  +  A*(Qi  -  Q2) 

(41) 


Here  we  notice  that  Qi  —  Q2  has  been  added  to  the  upper-right  block  of  the  right-hand  side 
matrix.  This  does  not  change  the  value  of  the  determinant. 

The  two  determinants  in  (41)  are  different  only  at  the  first  column.  By  using  the  property 
of  determinant  on  column  addition  and  the  partition  of  Qi  and  Q2,  we  have 


0 


det 


c 


0 


A*(Qi2  —  Q22)  +  Q22 
0 
0 


Qi  -  Q2 
A*(<7i  -  |2)t  + 

A*(Qi2  —  Q22)t  +  Q22 


=  0 


det 


t 

a*(<5i2  —  Q22)  +  Q22  ^  Qi  —  Q2 

0  a*(Qi2  -  <?22)t  +  Q22 


=  0. 


The  last  equality  is  (15). 


□ 
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Abstract 

Several  equivalent  conditions  or  statements  for  set  invariance  were  obtained  for  systems 
with  one  saturating  actuator  in  a  recent  paper.  In  particular,  it  was  shown  that  the  invariance 
of  an  ellipsoid  under  a  saturated  linear  feedback  is  equivalent  to  its  controlled  invariance  and 
also  to  the  existence  of  a  feedback  linear  inside  the  ellipsoid  that  makes  it  invariant.  In  this 
paper,  we  attempt  to  extend  the  results  to  systems  with  multiple  saturating  actuators.  Our 
analysis  reveals  that  the  equivalence  holds  conditionally  for  some  pairs  of  the  statements  and 
does  not  hold  for  some  other  pairs. 
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1  Introduction 


The  notion  of  invariant  set  has  played  a  very  important  role  in  the  study  of  systems  with  state 
and  control  constraint  (see  [1]-[13],  [15]-[17]  and  the  references  therein).  Invariant  sets  can  be 
used  to  estimate  the  domain  of  attraction  and  to  study  disturbance  rejection  properties.  We 
have  been  particularly  interested  in  invariant  ellipsoids  since  quadratic  Lyapunov  functions  are 
the  most  popular  and  the  results  can  often  be  put  into  simple  and  compact  forms,  which  makes 
analysis  and  design  easily  implementable.  Recently,  we  obtained  a  series  of  encouraging  results 
on  invariant  ellipsoids  (  see,  e.g.,  [7,  8, 10,  11]).  In  [10]  and  [11],  we  derived  simple  conditions  for 
set  invariance  in  the  form  of  LMIs,  for  both  continuous-time  and  discrete-time  linear  systems 
under  actuator  saturation.  These  conditions  are  then  used  for  designing  controllers  to  enlarge 
the  domain  of  attraction  and  to  improve  the  performance  of  disturbance  rejection. 

In  a  recent  paper  [7],  we  gave  a  complete  characterization  of  invariant  ellipsoids  for  single 
input  systems  with  actuator  saturation.  Four  equivalent  conditions  or  statements  on  set  invari¬ 
ance  are  presented.  In  particular,  it  was  shown  that  if  an  ellipsoid  is  controlled  invariant  (i.e.,  it 
can  be  made  invariant  with  a  nonlinear  feedback  bounded  by  the  saturation  level),  then  there 
exists  a  feedback  which  is  linear  inside  the  ellipsoid  that  makes  it  invariant.  Also,  suppose  that 
an  ellipsoid  is  invariant  under  a  linear  feedback  u  =  Fx,  then  it  is  invariant  under  the  saturated 
linear  feedback  u  =  sat(Fx)  if  and  only  if  the  ellipsoid  is  controlled  invariant.  Since  one  of 
the  equivalent  conditions  can  be  put  in  the  form  of  LMI,  these  properties  make  it  very  easy  to 
analyze  and  construct  invariant  ellipsoids. 

In  this  paper,  we  attempt  to  extend  the  results  in  [7]  to  multi-input  systems.  Our  investiga¬ 
tion  shows  that  some  pairs  of  the  statements  are  conditionally  equivalent  and  some  other  pairs 
are  not  equivalent. 

Notation:  In  this  paper,  we  use  sat  :  Rm  Rm  to  denote  the  standard  saturation  function  of 
appropriate  dimensions.  For  u  G  Rm,  the  zth  component  of  sat  (a)  is  sign(u,)  min{l,  HI-  The 
infinity  norm  of  u  is  denoted  as  |u|oo.  For  an  m  x  n  matrix  H,  we  use  hi  to  denote  its  ith  row 
and  for  an  n  x  m  matrix  B,  we  use  bi  to  denote  its  zth  column. 

2  Problem  statement  and  preliminaries 

Consider  a  linear  system  with  input  saturation 

x  =  Ax  +  Bu,  x  6  R",  u  G  Rm,  |u|oo  ^  1*  W 

Let  P  G  Rnxn  be  a  positive-definite  matrix.  For  a  positive  number  p,  denote 

S(P,p)  =  {x€Kn:x'TPx<p}. 
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We  are  interested  in  the  controlled  invariance  of  an  ellipsoid  £(P,  p)  and  its  invariance  under  a 
given  feedback  u  =  f(x),  especially,  u  =  sat (Fx).  Let  us  first  give  formal  definitions  of  these 

notions. 

Denote  V(x)  =  xTPx.  Under  the  control  u,  the  derivative  of  V  along  the  trajectory  of  the 
system  (1)  is 

y(rr,u)  =  2  xTP(Ax  +  Bu). 

The  ellipsoid  £(P,p)  is  invariant  under  a  given  feedback  control  u  =  f(x)  if 


V(x,  f{x))  =  2xTP{Ax  +  Bf(x))  <0  Va;  G  £{P,p). 


It  is  contractively  invariant  if 

V(x,  f[x))  =  2  xrPiAx  +  Bfix))  <0  Va;  G  £(P,p)  \  {  0}. 

The  ellipsoid  8  (P,  p)  is  controlled  (contractively)  invariant  if  there  exists  a  vector  function  fix) . 
Rn  i->  Rm,  |/(x)|oo  <  1,  that  makes  it  (contractively)  invariant. 

As  said  before,  we  are  particularly  interested  in  the  invariance  of  an  ellipsoid  under  a  sat¬ 
urated  linear  feedback  u  =  sat  (Pa;)  ■  This  problem  has  been  studied  in  [4]-[12]  and  [17].  For  a 
matrix  P  G  Rmxn,  define 

£(F):=jx6R":  |Px|co  <  l}  • 

If  P  is  a  feedback  gain  matrix,  then  £(P)  is  the  region  where  the  feedback  control  u  =  sat  (Pa:) 
is  linear  in  x.  We  call  C{F)  the  linear  region  of  the  saturated  feedback  sat(Pa;),  or  simply,  the 
linear  region  of  saturation. 

For  single  input  systems  (m  =  1),  we  obtained  four  equivalent  conditions  or  statements: 

Proposition  1  [7]  Given  a  P  >  0,  assume  that  5(P,p)  is  controlled  contractively  invariant  for 
some  p  >  0.  Letp>  0  be  given.  The  following  statements  are  equivalent: 

a)  8iP,p)  is  controlled  contractively  invariant; 

b)  £ ( P,  p)  is  contractively  invariant  under  the  control  u  =  —sign iBTPx); 

c)  £iP,p)  is  contractively  invariant  under  u  =  sat  (Pa;),  where  F  satisfies 

(A  +  BF)TP  +  P(A  4-  BF)  <  0; 


d)  There  exists  an  H  G  Rlxn  satisfying 


and  <P(P,  p)  C  CiH). 


(A  +  BH)rP  +  P(A  +  BH)  <  0 


2 


The  equivalence  of  a)  and  c)  implies  the  equivalence  of  controlled  invariance  and  the  invari¬ 
ance  under  a  saturated  linear  feedback.  Item  d)  implies  that  there  exists  a  feedback  which  is 
linear  inside  £(P,p)  that  makes  it  contractively  invariant. 

For  a  multiple  input  system  (m  >  1),  the  four  statements  in  Proposition  1  are  respectively 

al)  £{P,p)  is  controlled  contractively  invariant; 

bl)  £{P,p)  is  contractively  invariant  under  the  control  u;  =  -sign (bjPx),i  G  [l,m]; 
cl)  £{P,p)  is  contractively  invariant  under  u  =  sat [Fx),  where  F  satisfies 

(. A  +  BF)TP  +  P{A  +  BF)  <  0; 

dl )  There  exists  an  H  6  Rmxn  satisfying 

(A  +  BH)TP  +  P(A  +  BH)  <  0 

and  £[P,p)  C  C{H). 

In  this  paper,  we  will  investigate  the  equivalence  of  al)-dl).  It  is  clear  that  al)  is  the  weakest, 
i.e.,  it  is  a  necessary  condition  for  the  other  three.  From  Chapter  11  of  [6],  we  know  that  al)  and 
bl)  are  always  equivalent.  Hence  we  need  to  study  the  pairs  (bl,cl),  (bl,dl)  and  (cl,dl).  We 
will  establish  that  the  equivalence  of  bl)  and  dl)  is  conditional  and  the  condition  under  which 
the  equivalency  holds  will  be  identified.  Numerical  examples  show  that  this  condition  is  usually 
satisfied.  In  particular,  dl)  could  be  stronger  than  bl)  in  some  special  situations.  However,  the 
pairs  (cl,dl)  and  (bl,cl)  are  not  equivalent. 

3  Condition  for  the  equivalence  of  bl)  and  dl) 

In  [6],  it  was  shown  that  £(P,  p)  is  controlled  contractively  invariant  for  some  p  >  0  if  and  only 
if  there  exists  an  F  such  that 

(A-\-BF)rP  +  P(A  +  BF)  <  0.  (2) 

Since  controlled  invariance  is  the  weakest  among  the  four  conditions,  we  will  assume  the  existence 
of  F  satisfying  (2)  throughout  this  paper. 

We  have  also  shown  in  [6]  that  if  £(P,po)  satisfies  bl)  (or  dl)),  then  £(P,p)  satisfies  bl)  (or 
dl))  for  all  p  <  po-  In  view  of  this,  we  only  need  to  compare  the  largest  ellipsoid  satisfying  bl) 
and  the  largest  ellipsoid  satisfying  dl).  Let  p*b  be  the  supreme  of  p  such  that  bl)  is  satisfied  and 
let  p*i  be  the  supreme  of  p  such  that  dl)  is  satisfied.  Then  we  have 

p*b  =  sup  \p  >  0  :  xTP  (ax  -  Yj bisign{bfPx)\  <  0  Vz  G  £ (P, p)  \  {0}  j  (3) 


3 


and 


Pd  =  suPff  P  W 

s.t  (A  +  BHfP  +  P{A  +  BE )  <  0, 

phiP-'hf  <  1,  »€[l,m]. 

Here  we  note  that,  the  condition  phiP^hJ  <  1,  G  [l,m],  is  equivalent  to  the  set  inclusion 
condition  E(P,p)  C  C{H). 


Lemma  1  Assume  that  there  exists  an  F  satisfying  (2).  We  have 

pi  =  min  jxTP:r :  xTP  ^  biSign(bJPx)  j  =0,  x  ±  0  j 


and 


Pd  =  raaxH  P 

s.t  (A  +  BH)TP  +  P(A  +  BH)<  0, 
phiP-lhJ  <  1,  «e[l,rn]. 


(5) 

(6) 


Proof.  Let 


pi  :=  min  jxTPx  :  xTP  ^ Ax  -  ^  ^sign^Px)^  =0,  x  ^  0  j . 


Prom  the  definition  of  p*b,  we  know  that  p*b  <  p\.  To  prove  that  pb  =  Pi,  it  suffices  to  show  that 
£(P,p)  is  controlled  contractively  invariant  for  all  p  <  pi- 

Under  the  assumption  of  the  existence  of  F  satisfying  (2),  there  exists  a,  po  >  0  such  that 
£ (P,  p)  is  controlled  contractively  invariant.  Hence 


g(k,x )  :=  (kx)TP  (  kAx  -  ^  bisign(bJPkx) 
\  i= l  J 


<0  Vk  G  (0,  l],xTPx  =  p0. 


Given  any  x  ±  0,  it  is  clear  that  g{k,x)  is  a  quadratic  function  of  k  with  p(0,a;)  =  0.  If 
g(k0,x)  =  0,  then  we  must  have  g(k,x)  <  0  for  all  k  G  (0 ,k0).  By  the  definition  of  pu  we  have 
g(k,x)  <  0  for  all  k  G  (0,  l),x  G  d£(P,pi),  which  means  the  controlled  contractive  invariance  of 

£{P,k2pi)  for  all  k  G  (0, 1).  Therefore,  pi  =  pb- 

We  next  prove  (6).  Suppose  that  the  right  hand  side  of  (6)  equals  to  some  number  p2  instead 
of  p*.  We  need  to  prove  that  p2  —  Pd-  It  is  clear  that  p2  >  p*d-  Let  H*  an  optimal  solution 
to  (6)  and  let  F  satisfy  (2).  Denote  H{o)  =  aF  +  (1  -  a)P*,  then 


(A  +  BH(a))TP  +  P(A  +  BH{a))  <  0, 
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for  all  a  G  (0, 1].  Let  p  =  p2  —  £•  Then  for  any  small  number  e  >  0,  there  exists  a  sufficiently 
small  a  >  0  such  that  pln(a)P-lh${a)  <  1  for  all  i  €  [l,m].  This  means  that  S{P,p)  satisfies 
condition  dl)  and  hence  p*d  >  p  =  p2  ~  £•  By  taking  £  arbitrarily  small,  we  obtain  p*d  =  p2  and 
(6)  follows.  D 

Lemma  2  Define 

A*(7)  =  min#  \max((A  + BH)rP  +  P(A  + BH)),  (7) 

s.t  hiP^hJ  <  7,  i  G  [l,m]. 

Then  A*  (7)  is  a  convex  function  of  7  and  it  is  monotonically  decreasing.  Moreover,  A*(l  /  pd)  =  0. 

Proof.  The  monotonically  decreasing  property  is  obvious  and  the  convexity  of  A*  (7)  follows 
from  the  fact  that  both  A max((A  +  BH^P  +  P(A  +  BH))  and  hiP~lhJ  are  convex  in  H. 

We  now  prove  that  A*(l /p*d)  =  0.  Let  H ,  be  an  optimal  solution  to  (6),  then  we  must  have 
Ama x{{A  +  BH*yP  +  P{A  +  BH*))  =  0  and  KiP^hfi  <  l/p*d.  It  follows  that  A*(l /p*d)  <  0. 
Suppose  on  the  contrary  that  A*(l /p*d)  <  0,  then  there  exists  an  Hi  such  that  huP~l  {huY  < 
1  /p*d,  i  €  [l,m],  and 

Amax((^  +  BHifP  +  P(A  +  BHi))  <  0. 

Hence  there  exists  a  k  G  (0, 1)  such  that 

{A  +  BkHxfP  +  P{A  +  BkHi)  <  0. 

Since  (p*d/k2)(khu)P~l(khuY  <  Y  we  have 

p*djk2  <  maxff  p 

s.t  {A  +  BHYP  +  P{A  +  BH)  <0, 
phiP~lhJ  <  1,  i€[l,m], 

which  implies  that  pd/k2  <  pd.  This  is  a  contradiction  since  k  G  (0, 1). 

Therefore,  we  must  have  A*(l /pd)  =  0.  D 

From  Lemma  2,  we  also  know  that  if,  is  an  optimal  solution  to  (6)  if  and  only  if  it  is  an 

optimal  solutuion  to  (7)  for  7  =  1  /pd. 

We  next  proceed  to  investigate  the  possibility  that  p*b  =  p*d. 

Theorem  1  Let  if*  be  an  optimal  solution  to  (6)  and  (7)  for  7  =  1  / p*d-  Denote 

Wm  =  (A  +  BHffP  +  P{A  +  BH*)- 

If  W *  has  only  one  eigenvalue  at  0,  then  pb  =  p*d. 
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Proof.  It  is  clear  that  p£  >  p*d.  In  view  of  (5),  to  prove  that  pi  -  p*d,  it  suffices  to  find  an 
xq  G  dS  (P,  p*d)  such  that 

V{xQ )  =  2xl P  -  Xj  bisign{bjPx0)  j  =  0.  (8) 

The  proof  is  lengthy.  The  main  idea  is  to  construct  such  an  x0  from  the  eigenvector  of  W* 
corresponding  to  the  0  eigenvalue.  To  show  (8),  we  need  to  carry  out  an  intricate  analysis  on 
the  relation  between  this  eigenvector  and  H *  by  exploring  the  properties  of  the  optimal  solution 

to  (7). 

We  assume  for  simplicity  and  without  loss  of  generality  that  P  =  I  and  pd  =  1.  If  not  so,  a 
state  transformation  of  the  form  x  =  (P/p*d)^  can  be  used  to  satisfy  this  assumption.  Under 
this  assumption,  we  have 

1  =  pa  =  maxff 
s.t 

By  Lemma  2, 

0  =  A*(l)  =  minff 
s.t 

Let  if*  be  an  optimal  solution.  There  must  exist  an  i  such  that  Kih^  =  1.  Otherwise,  there 
would  be  a  neighborhood  of  if,,  Af(H,)t  such  that  h{hj  <  1  for  all  H  G  M(H.).  Since  there 
exists  an  F  such  that  (A  +  BF)T  +  A  +  BF  <  0,  there  exists  an  H  =  aF  +  (1  -  a)H*  G  Af{H*) 
such  that  (A  +  BH)T  +  {A  +  BH)  <  0,  which  is  in  contradiction  with  that  A*(l)  =  0.  Let  the 
number  of  i  such  that  =  1  be  mi.  Without  loss  of  generality,  assume  that 

Kihli  =  1,  i  G  [l,mi], 

and 

h*ih*i  <1,  i  6  [mi  +  1,  m]. 

Otherwise,  the  columns  of  B  and  the  rows  of  if*  can  be  permuted  to  make  it  so. 

The  optimality  of  the  solution  if*  to  (10)  means  that  \max{(A  + BH)r  +  (A  +  BH))  cannot 
be  decreased  by  varying  if  in  a  neighborhood  of  if*  along  any  direction  which  keeps  it  within 
the  constraint.  Let  if  =  if*  +  A:Aif,  where  A  if  represents  the  varying  direction,  then  Amax((^+ 
BH)T  +  (A  +  BH))  cannot  be  decreased  along  the  following  direction  A  if , 


p  (9) 

(A  +  BH)T  +  (A  +  BH)  <0, 
hihj<l/p,  i  G  [l,m]. 

Ama x((A  +  BHr  +  (A  +  BH)),  (10) 

hihj  <  1,  i  G  [1,  to]. 
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1)  For  i  £  [1,  mi],  A  hi  is  tangential  to  the  sphere  surface  hihj  =  1  at  /i*,,  or,  A  hi  points 
inward  of  the  sphere  hihj  <  1  from  /i*jj 

2)  For  i  £  [mi  + 1,  m],  AhJ  £  Rn. 

Let  us  get  more  exact  implication  of  the  optimality  by  using  the  eigenvalue  perturbation 
theory  (see,  e.g.,  [14]).  Let  v  £  Rn  be  a  unit  eigenvector  of  W*  corresponding  to  the  single 
eigenvalue  at  0,  i.e., 

vTv  =  1,  W*v  =  0. 

For  the  perturbed  matrix  H  =  Ht  +  kAH,  denote 

A  max(*,  AH)  =  Amax((^4  +  B{H *  +  kAH))T  +  A  +  B(H*  +  kAH)). 

Then 

d\max/dk\k=0  =  vT((BAHr  +  BAH)v. 

The  optimality  of  the  solution  H *  implies  that  for  i  £  [l,mi], 

vr({biAhi)r  +  biAh{)v  =  0  V  A  hi  such  that  Ahih^  =  0,  (11) 

where  A  hih^  =  0  means  that  A  hi  is  tangential  to  the  sphere  surface  hihj  =  1,  and 

vT((biKi)T  +  bihti)v<  0,  (12) 

and  for  i  G  [mi  +  l,m], 

vT((biAhi)T  +  biAhi)v  =  0  V AhJ  £  Rn.  (13) 

Since  there  exists  an  F  such  that  (A  +  BF)T  +  A  +  BF  <  0  and  Amax((^4  +  BH)r  +  A  +  BH) 
is  convex  in  H,  there  is  a  direction  AH  =  F  —  H*  such  that 

vT((BAH)T  +  BAH)v  <  0. 

This  implies  that  there  is  at  least  one  i  £  [l,mi]  such  that 

vT((bih*i)T  +  bih*i)v  <  0.  (14) 

Let  the  number  of  i  satisfying  (14)  be  m0.  Without  loss  of  generality,  we  assume  that 

nT((6jh*i)T  4-  bih*i)v  <  0  Vi  G  [l,mo].  (15) 

Then  we  have,  for  all  i  £  [mo  +  l,m], 

vT((biAhi)T  +  biAhi)v  =  0  V  AhJ  £  Rn.  (16) 
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Let  €{  G  Rn  be  the  ith  unit  vector  whose  only  nonzero  element  is  the  ith  one  and  it  equals 
1.  Let  U  €  RnXn  be  a  unitary  matrix  such  that 

UTU  =  UUT  =  I,  ejU  =  h*i. 

To  utilize  (11),  consider  A/q  =  eJU,j  G  [2 ,n].  Then 

Ahi /&  =  eJUhh  =  ejUUTe\  =  ejei  =  0. 


From  (11),  we  obtain 

uT((61eJC/)T  +  6ieJC/)u  =  0  V  j  G  [2,n]. 

Let  v  =  Uv,  Si  =  Z7&i,  then 

vT((Mj)T  +  6ieJ)u  =  2u,-i)T5i  =  0  V  j  G  [2, n],  (17) 

and  (15)  implies  that 

uT((Sie[)T  +  hej)v  =  2Dii)T61  <  0.  (18) 

Equations  (17)  and  (18)  jointly  show  that  Vj  =  0  for  j  G  [2,  n]  and  v\  ^  0.  Since  v  is  a  unit 
vector,  we  must  have  v  =  ie]  .  Recalling  that  eJU  =  /i*i  and  v  =  Uv,  we  obtain 

vT  =  vT  U  =  ±eJU  =  ±K  i  •  (19) 

This  means  that  is  a  unit  eigenvector  of  W*.  For  simplicity,  we  let  v  =  h*v  It  follows  from 
same  arguments  that  vr  =  ±hti,  i  6  [2,m0].  Therefore,  =  ±K l  for  *  G  [2,  too]  and 

WXi=°  Vi  G  [1, too]-  (2°) 


With  v  =  h,Ju  condition  (15)  can  be  rewritten  as 

h»i((6,/i*t)T  +  bih*i)h1 i  =  2h*ihJibJhh  =  2/i*i/iJ157^*i  <  0- 

It  follows  that 

bjhli  <0,  i  G  [1,too].  (21) 

For  i  G  [mo  +  l,m],  it  follows  from  (16)  that  vT((MT)T  +  biVT)v  =  0.  Thus,  vTbi  =  0,  i.e., 

bjKi  =0,  i  G  [m0  +  1,to].  (22) 

Let  so  =  /iJi-  Then  for  *  e  [l>mo],  we  have  h,iXo  =  ±1-  If  /i«^o  =  1,  then  h *i  —  ^*i  and 
from  (21), 

-sign(67x0)  =  —sign(bjh*i)  =  1  =  /i*iOJo- 
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Similarly,  if  h^x o  =  —1,  then  h*i  =  —  /i*i  and  from  (21), 


In  summary,  we  have 


-sign(bfxo)  =  sign(6j/i*j)  =  — 1  =  h*iX  q. 


-sign(bJxo)  =  KiXq,  i  G  [l,mo]. 


As  for  i  G  [m0  +  1,  m],  since  xj&i  =  hjbi  =  0, 

Xobih*iZo  =  -x$ 6j  sign(6^o)  =  0,  i  G  [m0  +  1,  m]. 

Combining  (23)  and  (24),  the  derivative  F(x0)  under  the  control  of  Ui  =  -sign^Px)  is 

m 

V(x0)  =  xo  (^-T  +  A)xo  ~  2  £  *0 1 sign(&?x0) 

i= 1 
m 

=  xJ(AT  + A)xo  +  2^xj6i/i*ixo 
i=l 

=  xJ(AT  +  A  +  (PP*)T  +  PP*)®o 
= 


Since  x0  G  £(P,p*d),  it  follows  from  (5)  that  <  p*d.  1=1 

From  Theorem  1,  we  see  that  conditions  bl)  and  dl)  are  equivalent  if  W*  has  a  single 
eigenvalue  at  0.  If  W*  has  two  identical  eigenvalues  at  0,  then  it  is  possible  that  pd  <  p*b. 


Example  1  We  consider  a  special  case  where 


1  0.5 
0.5  1 


,  B  =  A,  P  =  I. 


The  optimal  solution  to  (6)  is  F*  =  -I  with  p*d  =  1  and  W*  =  0.  Since  W*  has  two  identical 
eigenvalues  at  0,  Theorem  1  is  not  applicable.  For  second-order  systems,  p*b  can  be  obtained 
by  computing  V(x)  under  the  control  iq  =  —s\gn(bJPx)  for  all  x  G  d£(P,p)  and  iterating  on  p 
with  bisection  method.  For  this  system,  we  have  pb  =  1.2504  >  1  =  pd. 

In  the  next  example,  we  illustrate  the  possibility  that  W*  has  multiple  eigenvalues  at  0. 

Example  2  There  are  three  parameters,  A,  B  and  P,  that  determine  the  optimal  W*.  To  ensure 
that  £(P,p)  can  be  made  invariant  for  some  p  >  0,  we  designed  a  fixed  algorithm  to  determine 
P  from  A  and  B.  For  instance,  a  feedback  matrix  P  is  chosen  to  place  the  eigenvalues  of  A+BF 
to  some  fixed  location  and  P  is  solved  from  {A  +  PP)TP  +  P(A  +  BF)  =  —I. 
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In  each  test,  we  fix  the  matrix  A  and  let  B  be  generated  by  “randn(2)”.  We  have  1000 
samples  of  B.  Because  of  numerical  error,  we  set  a  threshold  e  =  10e-5.  If  Amjn(W*)  >  —e,  then 
we  say  that  W*  has  two  identical  eigenvalues  at  0,  otherwise  it  has  two  distinct  eigenvalues.  It 
turns  out  that  the  outcome  depends  on  the  matrix  A.  Here  are  two  cases: 


1)A  = 


230; 


1  0.5 

0.5  1 


the  number  of  B’s  that  result  in  two  identical  zero  eigenvalues  of  W*  is 


is  103 


0.5 

1 


the  number  of  B’s  that  result  in  two  identical  zero  eigenvalues  of  W* 


Of  course,  these  numbers  are  changing  every  time  we  run  the  test  but  they  are  close  to  these 
values. 

These  computational  results  show  that  the  condition  in  Theorem  1  is  usually  satisfied.  This 
means  that  the  controlled  invariance  of  an  ellipsoid  is  usually  equivalent  to  the  existence  of  a 
feedback  linear  inside  the  ellipsoid  that  makes  it  invariant. 


4  The  equivalence  of  (cl,dl)  and  (bl,cl) 

We  will  actually  show  in  this  section  that  the  pairs  (cl.dl)  and  (bl,cl)  are  not  equivalent  for 
multiple  input  systems.  Define 

p*  :=  max  >  0  :  xTP(Ax  +  Bsa,t(Fx))  <0  ViG  £{P,p)}  • 

Then  p*  and  p*d  are  generally  not  equal.  Usually,  we  have  p*  <  p*d  <  but  it  is  also  possible 
that  p*c  >  p*d. 

In  [10],  we  established  a  sufficient  condition  for  an  ellipsoid  £(P,p)  to  be  contractively  in¬ 
variant  under  u  =  s&t(Fx):  there  exists  an  H  6  Rmxn  such  that  £(P, p)  C  C(H)  and 

{A  +  B(DF  +  D~H))TP  +  P(A  +  B(DF  +  D~H ))  <0  V£>  G  V, 

where  V  is  the  set  ofraxm  diagonal  matrices  with  only  0  or  1  diagonal  elements  and  D~  —  I— D. 
The  largest  p  satisfying  the  sufficient  condition  can  be  computed  as  follows, 

p*  =  max//  p  (25) 

s.t  (A  +  B(DF  +  D-H)fP  +  P{A  +  B(DF  +  D~H))  <0  VDeD, 

phiP~xhJ  <  1,  i  G  [l,m]. 

In  [9],  we  showed  that  we  usually  have  p*  =  p*c.  Since  the  constraint  in  (25)  is  more  restrictive 
than  that  of  (6)  (noting  that  if  D  =  0,  then  DF+D~H  =  H),  we  must  have  p*  <  p*d.  Therefore, 
we  usually  have  p*  <  p*d- 
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The  possibility  of  the  situation  that  p*c  >  p*d  can  be  observed  from  the  possibility  that  p*b  >  p*d, 
which  we  have  shown  in  Section  3.  In  [6],  we  showed  that  if  an  ellipsoid  is  controlled  contractively 
invariant,  then  there  exists  a  saturated  high  gain  linear  feedback  of  the  form  u  =  sat(J kBTPx) 
to  make  it  contractively  invariant.  This  implies  that  F  can  be  constructed  such  that  p*c  is 
arbitrarily  close  to  p*b.  In  the  case  that  p*b  >  p*d,  we  can  always  find  an  F  such  that  p*c  >  p*d. 


Example  3  In  this  example,  we  show  the  possibility  that  p *  <  pd.  As  in  Example  2,  we  fix 
1  0.5  " 


the  matrix  A  =  i  _q  5  ^ 

is  chosen  to  place  the  eigenva 


and  let  B  be  generated  by  “randn(2)”.  The  feedback  matrix  F 
lues  of  A  +  BF  to  -1  ±  0.5  and  P  is  solved  from  (A  +  BF)TP  + 


P(A  +  BF)  =  -I. 

In  the  test,  we  generated  1000  matrices  B.  Among  these  B’s,  894  of  which  result  in  p  —  pc 
and  in  all  of  these  cases,  p*  <  pd-  In  665  of  these  cases,  we  have  pd  >  1.01  pc. 


Example  4  In  this  example,  we  would  like  to  illustrate  the  possibility  that  p*c  >  pd.  We  use 

1  0,5  \b  =  A  and  P  =  I.  We  know  that 


the  same  system  as  in  Example  1,  where  A  = 


0.5 


p*  =  1.2504  and  pd  =  1.  By  choosing  F  =  -sat(20 BTPx),  we  obtain  p*c  =  1.248,  which  is 
greater  than  p*d  =  1. 


Let  us  give  some  remark  on  the  pair  (bl,cl).  The  relation  between  pb  and  p*  can  be  derived 
from  the  relation  between  other  pairs.  We  know  that  pb  >  p*.  Since  we  usually  have  pb  —  pd 
(see  Example  2),  and  p*d  >  p*c  (see  Example  3),  it  is  usually  true  that  p*b  >  p*c. 


5  Conclusions 

We  attempted  to  extend  our  previous  results  on  the  equivalence  of  several  set  invariance  con¬ 
ditions  for  single  input  systems  to  multi-input  systems.  It  turns  out  that  the  equivalence  hold ! 
conditionally  for  some  pairs  and  does  not  hold  for  some  other  pairs.  Computational  examples 
were  worked  out  to  illustrate  the  possibility  of  the  equivalence  of  each  pair  of  conditions. 
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Abstract 

A  sufficient  condition  for  an  ellipsoid  to  be  invariant  was  obtained  recently  and  an  LMI 
approach  was  developed  to  find  the  largest  ellipsoid  satisfying  the  condition.  This  condition 
was  later  shown  to  be  necessary  for  the  single  input  case.  This  paper  is  dedicated  to  the  multi¬ 
input  case.  We  will  examine  when  this  condition  is  also  necessary  for  multi-input  systems. 
Our  investigation  is  based  on  studying  the  optimal  solution  to  a  related  LMI  problem.  A 
criterion  is  presented  to  determine  when  the  condition  is  necessary  and  when  the  largest 
invariant  ellipsoid  has  been  obtained  by  using  the  LMI  method. 
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1  Introduction 


In  this  paper,  we  will  continue  to  study  the  set  invariance  property  for  a  linear  system  under 
saturated  feedback, 

x  =  Ax  +  Bsat(Fx).  (1) 

This  problem  has  been  studied  in  our  recent  works  [7,  9].  We  have  restricted  our  attention  to 
invariant  ellipsoids  since  quadratic  Lyapunov  functions  are  the  most  popular  and  the  results  can 
be  put  into  simple  and  compact  forms,  which  makes  analysis  and  design  easily  implementable. 
Moreover,  our  method  can  be  applied  to  different  ellipsoids.  The  union  of  multiple  invariant 
ellipsoids  forms  a  new  invariant  set.  In  the  literature,  invariant  ellipsoids  have  been  used  to 
estimate  the  domain  of  attraction  for  nonlinear  systems  (see  e.g .,  [1,  2,  3,  4,  5,  10,  11,  13]  and 
the  references  therein).  The  problem  of  estimating  the  domain  of  attraction  for  (1)  has  been  a 
focus  of  study  in  recent  years. 

For  a  matrix  F  G  Rmxn,  denote  the  ith  row  of  F  as  /*  and  define 
C(F)  :=  |i  £  R"  :  |M|<1,  *  =  1,2, 

If  F  is  a  feedback  gain  matrix,  then  £(F)  is  the  region  where  the  feedback  control  u  =  sat  (Fx) 
is  linear  in  x.  We  call  C(F)  the  linear  region  of  the  saturated  feedback  sat  (Fa;),  or  simply,  the 
linear  region  of  saturation. 

Let  P  G  Rnxn  be  a  positive-definite  matrix.  For  a  positive  number  p,  denote 

£{P,  p)  =  G  R"  :  xTPx  <  p }  . 

If 

(A  +  BFfP  +  P(A  +  BF)  <  0 

and  £{P,p)  C  £{F),  then  £{P,p)  is  an  invariant  ellipsoid  inside  the  domain  of  attraction.  The 
largest  of  these  £(P,p)’s  was  used  as  an  estimate  of  the  domain  of  attraction  in  the  earlier 
literature  (see  e.g.,  [4,  14]).  This  saturation  avoidance  estimation  method,  though  simple,  could 
be  very  conservative.  Recent  efforts  have  been  made  to  extend  the  ellipsoid  beyond  the  linear 
region  C{F)  (see,  e.g.,  [5,  10]).  In  particular,  simple  and  general  methods  have  been  derived  by 
applying  the  absolute  stability  analysis  tools,  such  as  the  circle  and  Popov  criteria,  where  the 
saturation  is  treated  as  a  locally  sector  bounded  nonlinearity. 

More  recently,  we  developed  a  new  sufficient  condition  for  an  ellipsoid  to  be  invariant  in  [9] 
(see  also  [6]).  It  was  shown  that  this  condition  is  less  conservative  than  the  existing  conditions 
resulting  from  the  circle  criterion  or  the  vertex  analysis.  The  most  important  feature  of  this 
new  condition  is  that  it  can  be  expressed  as  LMIs  in  terms  of  all  varying  parameters  and  hence 
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can  easily  be  used  for  controller  synthesis.  A  recent  discovery  makes  this  condition  even  more 
attractive.  In  [7],  we  showed  that  for  the  single  input  case,  this  condition  is  also  necessary,  thus 
the  largest  ellipsoid  obtained  with  the  LMI  approach  is  actually  the  largest  one.  With  this  new 
finding,  we  are  tempted  to  try  to  understand  if  this  condition  is  also  necessary  for  the  multi¬ 
input  case.  Our  investigation  identifies  cases  where  this  condition  is  also  necessary  for  multiple 
input  systems. 

Notation:  In  this  paper,  we  use  sat :  Rm  —>■  R771  to  denote  the  standard  saturation  function  of 
appropriate  dimensions.  For  u  E  R771,  the  ith  component  of  sat(u)  is  sign(u2)  min{l,  |u2|}.  The 
infinity  norm  of  u  is  denoted  as  |u|oo.  For  an  m  x  n  matrix  H ,  we  use  hi  to  denote  its  ith  row 
and  for  an  n  x  m  matrix  R,  we  use  &2  to  denote  its  ith  column. 

2  A  Sufficient  Condition  for  Set  Invariance 

i 

Consider  the  linear  system  subject  to  input  saturation, 

x  =  Ax  +  Bu,  xEHn,  u  G  Rm,  |n|oo  <  1.  (2) 

Under  a  saturated  linear  feedback  u  =  sat (Fx),  the  closed-loop  system  is, 

x  =  Ax  +  Bsat(Fx).  (3) 

Given  a  positive  definite  matrix  P,  let  V(x)  =  xTPx.  The  ellipsoid  £(P,p)  is  said  to  be 
(contractively)  invariant  if 

V(x)  =  2xrP(Ax  +  Bsat{Fx))  <  (<)0 

for  all  x  e  £(P,p)  \  {0}.  Clearly,  if  £(P,p)  is  contractively  invariant,  then  it  is  inside  the 
domain  of  attraction.  We  need  more  notation  to  present  the  sufficient  condition  for  £{P,p )  to 
be  contractively  invariant. 

Let  V  be  the  set  ofmxm  diagonal  matrices  whose  diagonal  elements  are  either  1  or  0. 
There  are  2m  elements  in  V.  Suppose  that  each  element  of  V  is  labeled  as  A,  i  =  1, 2,  •  •  • ,  2m. 
Then,  V  =  {A  :  i  G  [1, 2m]| .  Denote  Ar  =  I  ~  A-  Clearly,  Ar  is  also  an  element  of  V  if 
Di  €  V.  Given  two  matrices  F,H  €  Rmxn, 

[DiF  +  D-H:  i  €  [l,2m]} 

is  the  set  of  matrices  formed  by  choosing  some  rows  from  F  and  the  rest  from  H. 

Theorem  1  ([9,  6]).  Given  an  ellipsoid  £(P,p),  if  there  exists  an  H  E  Rmxn  such  that 

(A  +  B{DiF  +  D-H))TP  +  P{A  +  B(DiF  +  DrH))  <  0,  Vi  6  [1,2™],  (4) 

and  £{P,p)  C  C(H),  then  £{P,p)  is  contractively  invariant  under  the  feedback  u  =  sat(Fx). 
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It  is  clear  that  the  condition, 


(A  +  BF)TP  +  P{A  +  BF)  <  0,  (5) 

which  corresponds  to  (4)  for  Dt  =  I,  is  necessary  for  the  contractive  invariance  of  £{P,p)  for 
any  p  >  0.  Hence  we  assume  throughout  the  paper  that  (5)  is  satisfied. 

For  the  single  input  case  ( m  =  1),  we  have  shown  in  [7]  that  the  condition  in  Theorem  1  is 

also  necessary. 

Theorem  2  Assume  that  m  =  1.  Given  an  ellipsoid  £(P,p),  suppose  that  (5)  is  satisfied.  Then 
£(P,p)  is  contractively  invariant  under  the  feedback  u  =  sat (Fx)  if  and  only  if  there  exists  an 
H  6  Rlxn  such  that 

(A  +  BH)TP  +  P(A  +  BH)  <  0,  (6) 

and  £{P,p)  C  C{H). 

Here  we  note  that  when  m  =  1,  there  are  only  two  inequalities  in  (4),  namely,  (5)  and  (6). 

3  Necessity  of  the  Set  Invariance  Condition 

In  this  section,  we  will  study  the  necessity  of  the  condition  in  Theorem  1  for  multi-input  case. 
First,  let  us  consider  the  largest  ellipsoid  that  satisfies  the  condition.  Let  P  >  0  be  given,  define 

p*  :=  sup/)  W 

H 

s.t.  a)  (. A  +  B(DiF  +  DrH))TP  +  P(A  +  B(DiF  +  DrH))<0 ,  i  G  [l,2m], 
b)  phjP-lh]  <  1,  je[l,m]. 

Recall  from  [8,  6]  that  constraint  b)  is  equivalent  to  £{P,p )  C  C{H).  Consider  a  closely 
related  optimization  problem 

p\  :=  sup  p 
H 

s.t.  a)  (A  +  B(DiF  +  DrH))TP  +  P(A  +  B(DiF  +  D~ H))  <0,  i  6  [1, 2m], 
b)  phjP-lh]  <  1,  j  e  [l,m]. 

The  only  difference  between  (7)  and  (8)  is  the  “<”  in  (7a)  and  “<”  in  (8a).  We  claim  that 
p*  —  p*.  It  is  easy  to  see  that  p*  <  p*  since  (7a)  is  more  restrictive  than  (8a).  Let  (pi ,  H)  be  an 
optimal  solution  to  (8).  To  prove  that  p*  >  p\,  it  suffices  to  show  that  given  any  e  >  0,  there 
exist  H  and  p,  with  p>p*x-e,  such  that  (7a)  and  (7b)  axe  satisfied.  Let  H  =  (1  -  S)H  +  6F, 
where  6  G  (0, 1)  is  to  be  determined  later.  Recalling  that  Dt  +  Dt  =  I,  we  have 

DtF  +  DfH  =  8F  +  (1  -  5){DiF  +  Df  H). 
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By  assumption,  we  have  (5).  It  follows  that 

(A  +  B{DiF  +  DTByfP  +  P(A  +  B(DiF  +  D~  H )) 

=  S  ((4  +  BFfP  +  P(A  +  BP)) 

+(1  -  S)  ((A  +  B{DiF  +  DfH))TP  +  P(A  +  B{DiF  +  D~ H))) 

<0, 

for  all  5  €  (0, 1).  Hence  (7a)  is  satisfied  for  all  these  H ’s.  Since  H  -H  =  S(F  -  H )  can  be  made 
arbitrarily  small  and  fihjP-'h]  <  1,  given  any  e  >  0,  there  exists  a  <5  >  0  such  that 

{p\  -  e)hjP-lh]  =  ( p\  -  e)(hj  +  S(fj  -  hj))P^(k  +  Wj  -  h))T  ^  L 

This  that  p  =  p\  -  e  and  H  =  (1  -  8)H  +  SF  satisfies  (7a)  and  (7b)  for  some  5  >  0.  Thus 

we  have  p*  =  p\.  Here  we  note  that  condition  (5)  is  critical  in  establishing  the  equality  p*  =  p*v 
From  Theorem  1,  we  know  that  if  p  <  p*,  then  £{P,p)  is  contractively  invariant.  If  we  can 
conclude  that  p  >  p*  implies  that  £(P,p)  is  not  contractively  invariant,  then  the  condition  in 
Theorem  1  is  also  necessary.  However,  this  is  not  always  the  case. 

Define 

pc  :=  sup  |  p  >  0  :  £{P,p)  is  contractively  invariant  J  . 

It  is  clear  that  pc  >  p*.  We  will  show  that  pc  =  p*  is  conditional. 

Also,  let  (p*,H)  be  an  optimal  solution  to  (8).  There  must  be  a  j  such  that  p*hjP~xK ]  =  1 
and  there  must  be  an  i  such  that 

Amax  ((A  +  B(DiF  +  D-H))tP  +  P(A  +  B{D{F  +  D~H)))  =  0.  (9) 

Theorem  3  Let  (p*,H)  be  an  optimal  solution  to  (8).  Suppose  that 

1)  there  is  only  one  j  such  that  p%P~lh]  =  1  (i.e.,  the  boundary  of  £(P,p*)  only  touches 
one  pair  of  the  planes  hjX  =  ±1 

2)  there  is  only  one  i  satisfying  (9),  the  matrix  in  (9)  has  a  single  eigenvalue  at  0  and  the 
only  nonzero  element  in  is  the  jth  diagonal  one  (L) {  H  chooses  only  hj ) ■ 

Let  xq  =  p* P~lhj,  then  x0  is  the  unique  intersection  of  £(P,  p*)  with  hjX  =  1.  If 

3)  \fkxo\  <  1  for  al1  k  7 £  h 
then  p*  —  pc- 
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Proof.  To  simplify  the  proof,  we  would  like  to  make  some  special  assumptions.  First,  we  assume 
that  p*  —  1.  Otherwise  we  can  scale  the  matrix  P  to  make  it  so.  We  also  assume  that  j  —  1. 
Otherwise  we  can  permute  the  columns  of  the  B  matrix. 

Next,  we  assume  some  special  forms  of  the  matrices  P  and  H.  Suppose  that  we  have  a  state 
transformation,  x  -+  z  -  Tx.  Then  the  invariance  of  £{P,p)  for  the  x  system  is  equivalent  to 
the  invariance  of  £(P^  p)  for  the  z  system 

z  =  Az  +  Bsat(Fz), 


with 

P  =  (T~1)tPT-1,  A  =  tat~1,  b  =  tb,  f  =  ft-\ 

Also  let  7l  =  HT'1.  With  the  above  transformation,  the  three  conditions  l)-3)  in  Theorem  3 
remain  unchanged.  In  view  of  the  above  arguments,  we  can  assume  that  P  =  I  and  hi  = 
[1  0  •••  0].  Otherwise,  we  can  use  a  unitary  transformation  ( TTT  =  I)  to  make  it  so,  noting 

that  p*h\P~lhAi  =  1  and  p*  =  1. 

In  summary,  we  assume  that  p*  =  1 ,  P  =  I  and 

hi  =  [1  0  •••  0]. 


In  this  case,  we  have  xo  =  [1  0  •  •  •  0]T,  XqPxo  —  1  —  p*  and  hixo  —  1,  *-e.,  xq  is  the  unique 
intersection  of  the  ellipsoid  £(P,p*)  with  the  hyperplane  h\x  =  1. 


Denote 


Q(hi)  =  A  +  B 


P+P  A+B  . 


=  [A  +  ^bjfj  P  +  P  A  +  ^tyfi]  +(b ihi)rP  +  Pbihi 


Under  condition  2),  we  have  Amax  (Q(/h))  =  0.  Let  the  unit  eigenvector  of  Q{hx)  corresponding 
to  the  zero  eigenvalue  be  v,  i.e.,  vTv  =  1  and  Q{hi)v  =  0.  In  the  remaining  part  of  the  proof, 
we  will  first  show  that  Q(hi)x0  =  0,  and  under  condition  3),  we  will  further  have  V(x0)  =  0. 
This  leads  to  pc  <  p*  and  hence  pc  =  p*. 

Step  1:  Q(h{)xo  =  0. 

Under  condition  1),  the  only  equality  in  (8b)  is 


p*hiP~%  =  1, 
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and  all  the  others  have  strict  “  <  Under  condition  2),  we  have 

(A  +  B(DiF  +  D~ H))TP  +  P(A  4-  B(DiF  +  D~ H ))  <  0 


for  all  i  €  [1, 2m],  except 

Q(hi)  <  0. 

Hence,  there  is  a  neighborhood  of  H,  N(H),  where  all  the  conditions  in  (8a)  and  (8b)  are 
satisfied  except  p*hiP~lhJ  <  1  and  Q(hx)  <  0.  Let  us  restrict  H  6  Af(H),  we  must  also  have 

p*  =  sup  p  (1®) 

s.t.  (8a),  (8b), 


with  an  optimizer  H.  Since  for  any  H  e  M(H),  all  the  conditions  in  (8a)  and  (8b)  are  satisfied 
except  p*hxP-lK[  <  1  and  Q(hx)  <  0,  the  pair  (p*,H)  must  also  be  the  optimal  solution  to 


sup  P 

(11) 

phiP~lhi  <  1, 

(12) 

Q(hi)  <  0. 

(13) 

The  optimality  of  the  solution  means  that  if  we  scale  down  h\  from  hi  to  khx,  k  <  1,  condi¬ 
tion  (13)  must  be  violated,  otherwise  a  p  greater  than  p*  would  be  allowed  for  condition  (12). 
Observing  the  special  form  of  /ii,  we  have 


v 


T 


dQ(hi) 

dhn 


<0, 


(14) 


which  means  that  a  decrease  of  hn  from  1  would  increase  the  largest  eigenvalue  of  Q(hx).  This 
relation  is  obtained  by  using  eigenvalue  perturbation  theory  ( e.g .,  see  [12]).  Recalling  that 
P  =  I,  we  can  rewrite  (14)  as 


2&n  bX2 


b\n  0 


bin 

0 

0 


n 

v  =  2v\  ^2  buVi  <  0. 
i=  1 


(15) 


Also,  the  optimality  of  p*  means  that  if  we  change  other  elements  of  hi  over  the  sphere  surface 
p*hiP~1hJ  =  hi  hi  =  1,  we  will  have  Amax  (Q(hX))  >  0,  otherwise  a  p  greater  than  p *  would  be 
allowed.  All  the  hi  in  the  surface  h1h]'  =  1  and  in  a  neighborhood  of  hi  can  be  expressed  as 


hi  =  [i/l  —  (d|  +  H - +  d£)  d2  dn ],  d\  +  d\  + - \-d„<\. 
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Since  Amax(Q(/ii))  has  a  local  minimum  at  hi  =  hi,  by  eigenvalue  perturbation  theory,  we  must 
have 


dQ(h!) 

ddj 


=  0,  j  €  [2,n]. 


(16) 


hi~h\ 


With  the  special  form  of  P,  we  can  rewrite  (16)  as 

0  •  •  •  6n  •  •  •  0 


fen  •  •  •  2&ij 


feln 


V  =  2 Vj  blivi  —  2 Vj  Y2  h ivi  =  0. 

i=l  i=l 


(17) 


0  • • •  feln  ‘  *  0 

The  relations  (15)  and  (17)  jointly  show  that  v\  ±  0  and  Vj  =  0,  j  €  [2,n],  and  hence  v  is  aligned 
with  rro-  Therefore, 

Q(hi)a;0  =  0. 


Step  2:  V{xo)  =  0. 

From  (15)  and  Vj  —  0 ,j  G  [2,n],  we  have  &u  <  0.  From  condition  3)  of  the  theorem, 
\fkx0\  <  1  for  all  k  €  [2 ,m].  It  follows  that 

V'(so)  =  (atP  +  PA  +  ^Z(/fc  fefcP  +  Pbkfk)  j  xo  +  2xQPb1sat(fix0) 

\  k= 2  / 

=  xq  (atP  +  P^4  +  ]T](/k  fefcP  +  Pbkfk)  J  so  +  26nsat(/ixo). 

V  fc=2  / 

Since  Q(hi)s0  =  0,  we  have 
0  =  a:o<3(hi)a;o 

=  arj  f vlTP  +  Pj4  +  £ +  Pbkfk)  +  h[%P  +  Pb^i)  so 


k~2 

7X1 


=  xl  j^4TP  +  PA  +  £  (/*Tfe£P  +  Pbkfk)J  xo  +  2 fen , 


noting  that  h\xo  =  1. 

On  the  other  hand,  from  (5), 


rnJ((A  +  BFfP  +  P{A  +  BF))x0 
=  4  (atP  +  PA+  £  (fkblp  +  Pbkfk))  so  +  2fen/irr0 

V  k= 2  / 

<0. 


(18) 


(19) 
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By  comparing  (18)  with  (19),  we  know  that 


Zbnfixo  <  2&ii. 

Recalling  that  bn  <  0,  we  obtain  fix o  >  1.  Thus  sat(/i2?o)  =  1  and 

F(zo)  =  xlQ{hi)xo  =  0. 

Since  x0  e  £(P,p*)i  this  implies  that  pc  <  p*.  Observing  that  pc  >  p*,  we  finally  have  pc  =  p*. 

□ 

Corollary  1  If  the  system  has  only  one  input,  i.e.,  m  =  1,  then  pc  =  p* ■ 

Proof.  In  this  case,  (8b)  has  only  one  equality  and  for  an  optimal  solution,  we  must  have 
p*HP~1HT  =  1.  Hence  condition  1)  in  Theorem  3  is  satisfied.  As  to  condition  2),  there  are  two 

inequalities  involved, 

(A  +  BF)rP  +  P{A  +  BF)<  0, 

and 

{A  +  BH)TP  +  P{A  +  BE )  <  0. 

For  the  first  one,  we  have  the  strict  u  <  ”  by  assumption  and  for  the  second  one,  we  must  have 

Ama*  ((A  +  BHfP  +  P(A  +  BH ))  =  0. 

Hence  condition  2)  is  also  satisfied.  Since  m  =  1,  condition  3)  vanishes  (or  is  satisfied  automat¬ 
ically).  D 

For  systems  with  multiple  inputs,  computational  experience  shows  that  conditions  1)  and  2) 
of  Theorem  3  are  generally  true.  This  can  be  explained  as  follows.  It  is  easy  to  see  that  1)  is 
generally  true.  Assume  that  it  is  p*h\P~1h]  —  1.  For  condition  2),  there  is  also  generally  only 

one  Di  such  that 

Amax  {[A  +  B(DiF  +  DfHfP  +  P(A  +  B(A F  +  D~ H))  =  0.  (20) 

We  would  like  to  show  that  this  D~  should  be  the  matrix  whose  only  nonzero  element  is  at 
(1, 1).  First,  D~  must  chooses  h\.  Otherwise,  (8a)  would  be  true  for  all  hi  in  a  neighborhood  of 
hi,  allowing  a  greater  p*.  Suppose  that  D~  also  chooses  some  other  hjt  say  h2,  then  we  would 
have  the  term 

{b2h2yp+pb2h2 
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in  the  matrix  in  (20).  Since  p*h2P~ll%  <  1,  we  can  let  h2  vary  in  a  neighborhood  of  h2  without 
violating  other  conditions  except  (20).  Generally,  there  would  be  certain  direction  A h2  such 
that  the  additional  term 

(b2A.h2)TP  +  Pb2kh2 


will  cause 

Amax  ((A  +  B(DiF  +  Dl H)TP  +  P(A  +  B(DiF  +  D~ H ))  <  0. 

This  would  also  allow  a  greater  p*. 

However,  condition  3)  in  Theorem  3  is  not  always  satisfied.  In  that  case,  we  may  have 
pc>  p*.  This  will  be  illustrated  in  an  example. 


4  An  Example 


Consider  a  two-input  system  with 

[0.6  -0.8  ' 

A  ~  0.8  0.6  ’ 

The  input  matrix  B  is  generated  randomly  with  normal  distribution.  F  is  a  feedback  matrix 
such  that  A  +  BF  has  eigenvalues  —  1  ±  j'0.6,  and  P  is  the  solution  to 


(A  +  BF)TP  +  P{A  +  BF)  =  -I. 


Computational  results  show  that  conditions  1)  and  2)  are  generally  satisfied  (97  out  of  100). 
condition  3)  is  often  satisfied  but  not  always  (88  out  of  100)  . 

The  following  are  two  sets  of  parameters  B  generated  randomly  and  the  corresponding 

optimization  results. 


Case  1. 


0.8030  0.9455 
0.0839  0.9159 


The  pole  assignment  feedback  matrix  F  and  the  P  matrix  are 


'  -1.2031 

1.7926  ' 

P  _ 

0.5366 

-0.2676  ' 

-0.4441 

-2.1447 

-0.2676 

0.7179 

The  optimal  solution  to  (8)  is  p*  =  0.4050  and 

—  _  f  -0.6633  1.1973 

H  ~  -0.0359  -1.1828 


-0.4420 
-0.8320 
in  Fig.  1,  where  the  four  solid 


We  also  have  xo 


.  All  the  conditions  in  Theorem  3  are  satisfied.  This  is  illustrated 
'lines  are  hyx  =  ±1  and  h2x  =  ±1,  and  the  four  dotted  lines  are 
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fix  =  ±1  and  fax  =  ±1.  The  ellipsoid  only  intersects  h^x  =  ±1.  This  shows  that  condition 
1)  is  satisfied,  condition  2)  is  verified  by  checking  the  eigenvalues  of  the  matrices  in  (8a).  We 
also  see  that  rco  is  between  the  two  lines  f\x  —  ±1.  This  means  that  condition  3)  is  satisfied. 
According  to  Theorem  3,  £(P,p*)  is  the  largest  invariant  ellipsoid.  This  is  verified  in  Fig.  2, 
where  V(x )  along  the  boundary  of  the  ellipsoid  £{P,p*)  is  plotted.  We  see  that  the  maximal 
value  reaches  0. 


Figure  1:  Illustration  of  the  conditions  for  case  1. 


Figure  2:  The  derivative  V  (x)  along  d£(P,p)-  case  1. 


Case  2.  We  have 


0.8828  -0.1455 
0.2842  -0.0896  ’ 


and 


-2.6921  -9.1511 

-0.9778  -18.2487  ’ 


0.2773  -0.3815 
-0.3815  7.8606 
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The  optimal  solution  to  (8)  is  p*  =  0.0342,  and 


H  = 


-1.2666 

0.0110 


-11.3745 

5.9181 


Here  we  have  xq  = 


-0.2403 

-0.0612 


It  is  verified  that  conditions  1)  and  2)  are  satisfied,  but 

condition  3)  is  not,  as  we  can  see  in  Fig.  3,  where  l/i^ol  >  l,i  =  1,2.  In  this  case,  it  is  likely 
that  £{P,  p*)  is  not  the  largest  invariant  ellipsoid.  As  can  be  seen  from  Fig.  4,  the  maximal  value 
of  F(a:)  along  the  ellipsoid  is  strictly  less  than  0.  This  means  the  the  largest  invariant  ellipsoid 
is  strictly  larger  than  £(P,p*). 


Figure  3:  Illustration  of  the  conditions  for  case  2. 


Figure  4:  The  derivative  V(x )  along  d£{P,  p*)-  case  2. 


5  Conclusions 

We  investigated  the  necessity  of  a  recent  condition  for  set  invariance  by  studying  the  optimal 
solution  of  a  related  LMI  problem.  We  developed  criterion  for  checking  if  the  largest  invariant 
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ellipsoid  has  been  obtained  by  solving  the  LMI  problem.  Examples  show  that  the  condition  may 
not  be  necessary  under  certain  circumstances. 
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Abstract 

In  this  paper,  we  consider  the  problem  of  maximizing  the  convergence  rate  inside  a  given 
level  set  for  both  continuous-time  and  discrete-time  systems  with  input  saturation.  We  also 
provide  simple  methods  for  finding  the  largest  ellipsoid  of  a  given  shape  that  can  be  made 
invariant  with  a  saturated  control.  For  the  continuous-time  case,  the  maximal  convergence 
rate  is  achieved  by  a  bang-bang  type  control  with  a  simple  switching  scheme.  Sub-optimal 
convergence  rate  can  be  achieved  with  saturated  high-gain  linear  feedback.  We  also  study 
the  problem  of  maximizing  the  convergence  rate  in  the  presence  of  disturbances.  For  the 
discrete-time  case,  the  maximal  convergence  rate  is  achieved  by  a  coupled  saturated  linear 
feedback. 
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1  Introduction 


Fast  response  is  always  a  desired  property  for  control  systems.  The  time  optimal  control  problem 
was  formulated  for  this  purpose  (see,  e.g.,  [3,  6,  8,  14,  15].  Although  it  is  well  known  that  the 
time  optimal  control  is  a  bang-bang  control,  this  control  strategy  is  rarely  implemented  in  real 
systems.  The  main  reason  is  that  it  is  generally  impossible  to  characterize  the  switching  surface. 
For  discrete-time  systems,  online  computation  was  proposed  but  the  computation  burden  is  very 
heavy  since  linear  programming  has  to  be  solved  recursively  with  increasing  time  horizon.  Also, 
as  the  time  horizon  is  extended,  numerical  problems  become  more  severe.  Another  reason  is 
that  even  if  the  optimal  control  can  be  obtained  exactly  and  efficiently,  it  results  in  open-loop 
controls. 

A  notion  directly  related  to  fast  response  is  the  convergence  rate  of  the  state  trajectories. 
To  motivate  our  problem  formulation,  we  consider  the  following  linear  system 

x  =  Ax ,  x  G  Rn.  (1) 

Assume  that  the  system  is  asymptotically  stable.  For  this  system,  the  overall  convergence  rate 
is  measured  by  the  maximal  real  part  of  the  eigenvalues  of  the  A  matrix.  Let 

a  =  —  max |Re(Ai(A))  :  i  =  1,2, •••  ,nj  , 

where  Re(A i(A))  is  the  real  part  of  the  ith  eigenvalue  of  A,  then  a  >  0.  For  simplicity,  assume 
that  A  +  al  is  neutrally  stable,  i.e.,  there  exists  a  positive  definite  matrix  P  such  that 

ATP  +  PA  <  —2aP. 

Then,  there  exists  a  nonzero  x  G  Rn  such  that 

xT(ATP  +  PA)x  —  -2  axTPx.  (2) 

Let  V(x)  =  xTPx.  Along  the  trajectory  of  the  system  (1), 

V(x)  -  xr(ATP  +  PA)x  <  -2 axTPx  —  -2 aV{x). 

Hence, 

YM  <-2a,  \/x  G  Rn  \  {0}.  (3) 

V{x) 

Furthermore,  because  of  (2),  we  have 

“  =  §m!n{~nif:  (4) 

Prom  (3),  we  obtain 

V(x(t))  <  e~2cttV(xo). 

Therefore,  we  call  a  the  overall  convergence  rate  of  the  system  (1).  For  a  general  nonlinear 
system,  the  convergence  rate  can  be  defined  similarly  as  in  (4).  Since  local  stability  is  a  more 
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general  property  than  global  stability,  we  would  like  to  define  the  term  convergence  rate  on  some 
subset  of  the  domain  of  attraction  of  the  origin.  Consider  a  nonlinear  system 


x  =  f{x). 


Assume  that  the  system  is  asymptotically  stable.  Given  a  Lyapunov  function  V^as),  let  Ly(p ) 
be  a  level  set 

Lv(p)  =  {xE  Rn:  V(x)<p}. 

Suppose  that  F(z)  <  0  for  all  x  G  Lv{p)  \  {0}.  Then,  the  overall  convergence  rate  of  the  system 
on  Ly(p)  can  be  defined  as 

a  :=  ^inf  :  x  €  Lv(p)  \  {0}|  •  (5) 


For  a  discrete-time  system 

x(k  + 1)  =  f(x{k)), 

we  can  define  the  overall  convergence  rate  on  Ly(p)  as 


where  Ay(rc)  is  the  increment  of  V(x)  along  the  trajectory  of  the  system.  We  can  also  define 
the  convergence  rate  at  each  point  x  in  the  state  space  as 


VM  („  _  AZM'l 

V(x)  1  V(x)  )  ' 

For  linear  systems  subject  to  actuator  saturation,  efforts  have  been  made  to  increase  the 
convergence  rate  in  various  heuristic  ways.  For  example,  the  Q  matrix  in  LQR  design  can  be 
increased  piecewisely[18]  or  continuously[16,  17]  as  the  state  trajectory  converges  to  the  origin. 
The  objective  of  this  paper  is,  for  a  given  V(x),  to  find  a  feedback  law  constrained  by  the 
actuator  saturation  such  that  —  V{x)  is,  maximized  at  each  x.  It  turns  out  that  the  optimal 
control  law  is  a  bang-bang  type  control  with  a  simple  switching  scheme.  Since  the  discontinuity 
might,  be  undesirable,  for  example,  causing  chattering  around  the  switching  surface,  we  will  also 
derive  a  continuous  control  law  which  results  in  a  convergence  rate  that  is  arbitrarily  close  to 
the  optimal  one.  The  proposed  continuous  control  law  is  a  saturated  high  gain  feedback.  As 
the  gain  goes  to  infinity,  the  saturated  high  gain  feedback  approaches  the  optimal  bang-bang 
control  law. 

For  a  discrete-time  system,  the  control  law  that  maximizes  the  convergence  rate  is  a  coupled 
saturated  linear  feedback.  If  the  system  has  one  or  two  inputs,  the  control  law  can  be  put  into  a 
simple  formula.  If  the  system  has  more  than  two  inputs,  the  controller  is  more  complicated.  It 
is  linear  inside  some  polyhedron.  Outside  of  this  polyhedron,  we  need  to  solve  a  simple  convex 
optimization  problem. 
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A  very  important  consequence  of  the  maximal  convergence  control  is  that  it  produces  the 
maximal  invariant  level  set  of  a  given  shape  (in  the  absence  or  in  the  presence  of  disturbances). 
It  is  easy  to  see  that  a  level  set  can  be  made  invariant  if  and  only  if  the  maximal  V(x)  on  the 
boundary  of  the  level  set  under  the  maximal  convergence  control  is  less  than  0.  As  is  pointed  out 
in  [1],  set  invariance  is  a  very  important  notion  and  a  powerful  tool  in  studying  the  stability  and 
other  performances  of  systems.  In  [2,  4,  5,  9,  10, 11],  invariant  ellipsoids  are  used  to  estimate  the 
domain  of  attraction  and  to  study  disturbance  rejection  capability  of  the  closed-loop  system.  In 
this  paper,  we  will  first  study  the  quadratic  type  Lyupnov  functions  and  then  extend  the  results 
to  a  general  Lyapunov  function.  We  will  present  a  simple  method  for  checking  if  an  ellipsoid 
can  be  made  invariant  and  for  determining  the  largest  ellipsoid  that  can  be  made  invariant. 

In  [11],  we  presented  methods  for  enlarging  the  invariant  ellipsoid  with  respect  to  some  shape 
reference  set.  As  a  result,  the  closed-loop  system  behaves  linearly  in  the  ellipsoid.  In  other  words, 
the  feedback  control  does  not  saturate  in  the  ellipsoid.  In  this  paper,  the  control  that  achieves 
maximal  convergence  rate  and  maximal  invariant  ellipsoid  saturates  almost  everywhere  in  the 
ellipsoid  (for  continuous-time  systems).  This  seemingly  contradiction  can  be  explained  with  the 
result  in  [12],  where  it  was  shown  that  for  a  single  input  system,  the  largest  invariant  ellipsoid  is 
somehow  independent  of  a  particular  stabilizing  controller.  Although  both  methods  in  [10,  11] 
and  in  this  paper  produce  large  invariant  ellipsoids,  the  focuses  of  these  papers  are  different. 
[10,  11]  put  the  optimization  problems  into  LMI  framework  and  makes  it  very  easy  to  choose  the 
shape  of  the  ellipsoid.  This  paper  assumes  that  the  shape  of  the  ellipsoid  is  given,  say,  produced 
by  the  method  of  [10,  11]  and  tries  to  maximize  the  convergence  rate  and  to  find  the  maximal 
invariant  set  of  the  given  shape. 

This  paper  is  organized  as  follows.  Section  2  and  Section  3  study  the  maximal  convergence 
rate  control  problems  for  continuous-time  and  discrete-time  systems,  respectively.  Sections  2.1 
—  2.4  deal  with  quadratic  Lyapunov  functions  and  Section  2.5  extends  the  results  to  a  general 
Lypunov  function.  In  particular,  Section  2.1  shows  that  the  maximal  convergence  control  is 
a  bang-bang  type  control  with  a  simple  switching  scheme  and  that  it  produces  the  maximal 
invariant  ellipsoid  of  a  given  shape.  A  method  for  determining  the  largest  ellipsoid  that  can 
be  made  invariant  with  a  bounded  control  is  also  given  in  this  section.  Section  2.2  presents  a 
saturated  high  gain  feedback  strategy  to  avoid  the  discontinuity  of  the  bang-bang  control.  An 
example  is  included  in  Section  2.2  to  illustrate  the  effectiveness  of  high  gain  feedback  control. 
Section  2.3  reveals  some  properties  and  limitations  about  the  overall  convergence  rate  and  pro¬ 
vides  methods  to  deal  with  these  limitations.  Section  2.4  shows  that  the  maximal  convergence 
control  also  achieves  both  the  maximal  and  the  minimal  invariant  ellipsoids  in  the  presence  of 
disturbances.  A  brief  concluding  remark  is  made  in  Section  4. 

Throughout  the  paper,  we  will  use  standard  notation.  For  a  vector  u  G  R"\  we  use  |u|co 
to  denote  the  oo-norm.  We  use  sat(-)  to  denote  the  standard  saturation  function  sat(s)  = 
sign(s)  min{l,  |s|).  With  a  slight  abuse  of  notation  and  for  simplicity,  for  a  vector  u  €  Rm,  we 
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also  use  the  same  sat (u)  to  denote  the  vector  saturation  function,  i.e., 

sat(u)  =  [sat(ui)  sat(u2)  sat(um)]T. 

We  use  sign(-)  to  denote  the  sign  function  which  takes  value  +1  or  -1. 

2  Continuous-time  Systems 

2.1  Maximal  Convergence  Rate  Control  and  Maximal  Invariant  Ellipsoid 

Consider  a  linear  system  subject  to  actuator  saturation, 

X  =  Ax  +  Bu,  xeRn,ue  Rm,  Moo  <  1-  (6) 

Assume  that  the  system  is  stabilizable  and  that  B  has  full  column  rank.  Let 

B  =  b\  62  *  ‘  ‘  bm  j  • 

In  [11,  10],  we  developed  a  design  method  for  enlarging  the  domain  of  attraction  under  a 
saturated  linear  state  feedback.  The  approach  was  to  maximize  the  invariant  ellipsoid  with 
respect  to  some  shape  reference  set.  The  optimized  controller,  however,  results  in  very  slow 
convergence  rate  of  the  closed-loop  system.  The  objective  of  this  paper  is  to  design  a  controller 
that  maximizes  the  convergence  rate  inside  a  given  ellipsoid.  Given  a  positive  definite  matrix 
P,  let 

V(x)  =  xTPx. 

For  a  positive  number  p,  the  level  set  associated  with  V{x)  is  the  ellipsoid, 

£ {P,p)  =  {a;  €  Rn  :  xTPx  <  p}  . 

Along  the  trajectory  of  the  system  (6), 

V{x,u )  =  2  xTP{Ax  +  Bu) 

m 

=  x't(ATP  +  PA)x-{-2'%2xTPbiUi. 

2=1 

Under  the  constraint  that  Moo  <  1,  the  control  that  maximizes  the  convergence  rate,  or  mini¬ 
mizes  V{x,u),  is  simply 

m  =  -sign(6j'Px),  *  =  1,2,”  •,«»,  (7) 

where  sign  :  R  -4  R  is  the  sign  function.  Under  this  bang-bang  control,  we  have 

m 

V(x)  =  xT(A'rP  +  PA)x  -  2  J2xrPbi  sign (bJPx). 

2=1 

Now  consider  the  closed-loop  system 

m 

x  =  Ax  -  bisign(bj Px) .  (8) 

i=i 
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Because  of  the  discontinuity  of  the  sign  function,  equation  (8)  may  have  no  solution  for  some 
rr(0)  or  have  solution  only  in  a  finite  time  interval.  For  example,  for  the  single  input  case  m  =  1, 
equation  (8)  will  have  no  solution  if  fFPz(O)  =  0  and  x  at  each  side  of  the  switching  plane 
BTPx  =  0  points  to  the  other  side.  We  will  use  a  continuous  feedback  law, 

Ui  =  -sat  (kbjPx), 

where  sat :  R  -4  R  is  the  standard  saturation  function,  to  approximate  the  bang-bang  control 
(7)  in  the  next  subsection.  In  what  follows,  we  use  the  bang-bang  control  law  to  investigate  the 
possibility  that  an  ellipsoid  can  be  made  invariant  with  a  bounded  control  Moo  <  1- 

Recall  that  an  ellipsoid  £(P,p)  is  invariant  for  a  system  x  =  f(x)  if  all  the  trajectories 
starting  from  it  will  stay  inside  of  it.  It  is  contractive  invariant  if 

V(x)  =  2 xTPf(x)  <0,  Vx  £  £(P,  p)  \  {o}. 

Since  the  bang-bang  control  (7)  minimizes  V(x,  u )  at  each  x,  we  have  the  following  obvious  fact. 

Fact  1  The  following  two  statements  are  equivalent: 

a)  The  ellipsoid  £{P,p)  can  be  made  contractive  invariant  for  (6)  with  a  bounded  control 
l^loo  —  Ij 

b)  The  ellipsoid  £(P,  p)  is  contractive  invariant  for  (8),  i.e.,  the  following  condition  is  satis¬ 
fied, 

m 

V(x)  =  x  T(ATP  +  PA)x  -  2'£/xTPbisign{bjPx)  <0,  Vi6  £{P,p)  \  {0}-  (9) 

t=i 

It  is  clear  from  Fact  1  that  the  maximal  convergence  rate  control  produces  the  maximal 
invariant  ellipsoid  of  a  given  shape.  We  will  see  in  Section  2.2  that  if  (9)  is  satisfied,  there  also 
exists  a  continuous  feedback  law  such  that  £(P,p)  is  contractive  invariant.  In  this  case,  all  the 
trajectories  starting  from  £{P,p)  will  converge  to  the  origin  asymptotically. 

For  an  arbitrary  positive  definite  matrix  P,  there  may  exists  no  p  such  that  £(P,p)  can  be 
made  invariant.  In  what  follows  we  give  condition  on  P  such  that  £(P,p)  can  be  made  invariant 
for  some  p  and  provide  a  method  for  finding  the  largest  p. 

Proposition  1  For  a  given  positive  definite  matrix  P,  the  following  three  statements  are  equiv- 
alent : 

a)  There  exists  a  p  >  0  such  that  (9)  is  satisfied ; 

b)  There  exists  an  F  6  Rmxn  such  that 

(A  +  BF)TP  +  P(A  +  BF)<0-,  (10) 
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(11) 


c)  There  exists  a  k  >  0  such  that 

(. A  -  kBBTP)rP  +  P{A  -  kBBrP )  <  0. 


Proof,  b)— ^  a).  If  (10)  is  satisfied,  then  there  exists  a  p  >  0  such  that 

£(P,p)cjiGRn:  |^|oo  <  l}  • 


If  x0  e  £(P,p),  then  under  the  control  u  =  Fx,  x(t)  will  stay  in  £(P,p)  and  we  also  have 
\u\oo  <  1  for  all  t  >  0.  This  means  that  £(P,p)  can  be  made  contractive  invariant  with  a 
bounded  control.  Hence  by  the  equivalence  of  the  statements  a)  and  b)  in  Fact  1,  we  have  (9). 


c)  -»  b).  It  is  obvious, 
a)  ->  c).  Let  us  assume  that 


PB  = 


0 

R  ’ 


where  R  is  an  m  x  m  nonsingular  matrix.  If  not  so,  we  can  use  a  state  transformation,  x  Tx, 
with  T  nonsingular  such  that 

p^p=(t~1)tpt-\ 


B  B  =  TB 


and 


PB  ->  PB  =  (T^fPB  = 


0 

R 


Recall  that  we  have  assumed  that  B  has  full  column  rank.  Also,  let  us  accordingly  partition  x 

i-  n 


x\ 

X2 


and  ATP  +  PA  and  P  as 


For  all 


ATP  +  PA  = 


'  Qi 

Ql2 

p  „ 

'  Pi 

Pl2  ' 

_  Ql2 

q2 

9  r  — 

.Pi 2 

P2 

Xl 

0 


6  9£(P,P), 


we  have  xTPB  =  0.  So,  if  a)  is  true,  then  (9)  holds  for  some  p  >  0,  which  implies  that 


xlQ\Xi  <  0, 


for  all  xi  such  that  xJPiXi  =  p.  It  follows  that  Qx  <  0.  Hence  there  exists  a  k  >  0  such  that 


(A  -  kBBTP)rP  +  P(A  -  kBBTP) 


Qi  Q12 

Qh  Q2-kRRT 


This  shows  that  c)  is  true. 

Suppose  that  we  are  given  a  shape  of  ellipsoid,  characterized  by  Pq  >  0,  and  that  the 
maximal  convergence  rate  is  desired  with  respect  to  V {x)  =  xTP0x,  but  this  shape  cannot  be 
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made  invariant  for  any  size,  then  we  can  take  £(P0, 1)  as  a  shape  reference  set  and  find  another 
invariant  set  £{P,p)  such  that  a£(P0, 1)  C  £{P,p)  with  a  maximized  by  the  method  in  [11,  10]. 
The  shape  of  the  resulting  invariant  ellipsoid  £{P,p)  will  be  the  closest  to  that  of  £(P0,1)- 
Now  assume  that  we  have  a  P  >  0  such  that  the  conditions  in  Proposition  1  are  satisfied. 
Given  p  >  0,  we  would  like  to  determine  if  £{P,p)  is  contractive  invariant  for  the  closed-loop 
system  (8).  Let’s  start  with  the  single  input  case.  In  this  case,  condition  (9)  simplifies  to 

V(x)  =  xT{ATP  +  PA)x  -  2xrPBsign{BTPx)  <0,  Vrc  G  £{P ,  p)  \  {0}.  (12) 

We  claim  that  (12)  is  equivalent  to 

XT(ATP  +  PA)x  -  2xTPBsign(BTPx)  <0,  Vz  G  d£ (P,  p).  (13) 

To  see  this,  we  consider  kx  for  k  G  (0, 1]  and  x  G  d£(P,  p)-  Suppose  that 
xT(ATP  +  PA)x  -  2xTPBsiga(BTP x)  <  0, 


Since 

— 2x'rPBsign(BTPx)  <  0, 


we  have 


Therefore, 


xT(ATP  +  PA)x  -  — -jjp—  sign(BTP x )  <0,  V k  G  (0, 1]. 

(kx)T(ATP  +  PA){kx)  -  2(kx)TPBsign{BTPkx) 

=  k 2  (xr(ArP  +  PA)x  -  —  fcP-sign(J 3TPx)j 

<0, 


for  all  k  G  (0, 1].  This  shows  that  condition  (12)  is  equivalent  to  (13).  Based  on  this  equivalence 
property,  we  have  the  following  necessary  and  sufficient  condition  for  the  contractive  invariance 
of  a  given  ellipsoid. 


Theorem  1  Assume  that  m  =  1.  Suppose  that  £(P,p)  can  be  made  contractive  invariant  for 
some  p  >  0.  Let  Ai,  A2,  •  •  • ,  Xj  >  0  be  real  numbers  such  that 


det 


XjP  -  ATP  -  PA 
p-lPBBTP 


XjP  -  ATP  -  PA 


=  0 


(14) 


B'TP{ATP  +  PA  -X jP)~lPB  >  0.  (15) 

Then,  £{P,p)  is  contractive  invariant  for  the  system  (8)  if  and  only  if 

XjP -  BTP(ATP  +  PA-  X jP)-lPB  <0,  Vj  =  1, 2, •  •  • ,  J. 

If  there  exists  no  Xj  >  0  satisfying  (If)  and  (15),  then  £(P,p)  is  contractive  invariant. 
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In  the  proof  of  Theorem  1,  we  will  use  the  following  algebraic  fact.  Suppose  that  X4,X4  and 


Xi  X2 
X3  X4 


are  square  matrices.  If  X\  is  nonsingular,  then 

=  det(.Xi)  det(X4  —  XzX±  lX2), 


det 


Xi  X2 

x3  x4 


and  if  X4  is  nonsingular,  then 

det 


Xi  X2 

x3  x4 


=  det(Xi)  det(Xi  —  X2X1  ^3) 


Proof  of  Theorem  1.  Denote 

g( x)  =  xT(ATP  +  PA)x  -  2 xTPB. 


(16) 


(17) 


By  the  equivalence  of  (12)  and  (13),  the  contractive  invariance  of  £{P,p)  is  equivalent  to 

max  {5(x)  :  BrPx  >  0,  xTPx  =  p)  <  0.  (18) 

Since  £(P,p)  can  be  made  contractive  invariant  for  some  p  >  0,  we  must  have  g{x)  <  0  for 
all  BT Px  =  0.  In  this  case,  the  contractive  invariance  of  £  (P,  p)  is  equivalent  to  that  all  the 
extrema  of  g(x)  in  the  surface  xTPx  =  p,  BTPx  >  0,  if  any,  are  less  than  zero. 

By  the  Lagrange  multiplier  method,  an  extremum  of  g(x)  in  the  surface  xT Px  =  p,  B  Px  > 

0,  must  satisfy 

(ATP  +  PA  —  A P)x  =  PB,  xTPx  =  p ,  xTPB  >  0,  (19) 

for  some  real  number  A.  And  at  the  extremum,  we  have 


g(x)  =  A p-  xTPB. 


If  A  <  0,  then  g(x)  <  0  since  xTPB  >  0.  So  we  only  need  to  consider  A  >  0. 
Now  suppose  that  A  >  0.  From 

(. ATP  +  PA  —  A  P)x  =  PB, 


we  conclude  that 

det(ATP  +  PA-  A P)  #  0. 

To  show  this,  we  assume,  without  loss  of  generality,  that 


ATP  +  PA 


Q\  Ql2 
Ql2  92 


P  = 


Pi  Pl2 

P\2  V2 


PB  = 


as  in  the  proof  of  Proposition  1,  it  follows  then  that  Qi  <  0.  Since  A  >  0,  Qi  <  0  and  P\  >  0, 
Qx  —  APi  is  nonsingular.  Let 

x\ 


x  — 


X2 


,  x2  eR 
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and  suppose  that  x  ^  0  satisfies 


(. ATP  +  PA  -  \P)x  =  PB, 


then, 

X\  =  —  (Qi  —  APi)_1(Ql2  —  APi2)®2> 

and 

(  -  (Q?2  -  AP^XQl  -  AJPl)“1(Ql2  -  AP12)  +  92  -  Ap2)  X2  = 
Multiplying  both  sides  with  det(Qi  -  APi)  and  applying  (16),  we  obtain 

det(ATP  +  PA-  A  P)x2  =  det(Qi  -  APi)r. 

Since  r  ^  0  and  det(Qi  -  APX)  ^  0,  we  must  have 

det(ATP  +  PA  -  AP)  #  0. 

So  for  all  A  >  0  and  a:  satisfying  (19),  we  have 

re  =  ( ArP  +  PA-  A P)"1PP, 

and  hence  from  xTPx  =  p, 

BTP(ATP  +  PA-  XP)-1P(ATP  +  PA-  XP)~lPB  =  p. 


Denote 

$  =  XP-ATP-PA, 
then  the  equation  (20)  can  be  written  as, 

BrP$~1P$~1PB  =  p. 

By  invoking  (16)  and  (17),  we  obtain 


det 


p  -£TP$ 
-§~rPB  P-1 


-1 


=  0 


t 


det 


P  0 
0  P-1 


BrP  0 

0  I 


&-1  0 
0 


0  I 

PB  0 


$ 


det 


( 

■  $  0  ' 

0  1' 

p  1  0 

'  £TP  0  ' 

1 

0  $ 

PB  0 

0  P 

0  I 

det 


$ 

AP  -  ATP  -PA  P 

p~l PBBTP  AP  -  ATP  -  PA 


=  0. 


This  last  equation  is  (14). 

Also,  at  the  extremum,  we  have  xTPB  >  0.  This  is  equivalent  to  (15), 

PTP(ATP  +  PA-  A P)~XPB  >  0. 

Finally,  at  the  extremum 

g(x)  =  xT(ATP  +  PA)x-2xTPP 

=  Xp  —  BTP(ATP  +  PA  —  AP)-1P  B. 

Hence  the  result  of  the  theorem  follows.  D 

Here  we  note  that  all  the  A/s  satisfying  (14)  are  the  eigenvalues  of  the  matrix 

■  P~2AtP*  +P2AP-2  -I 

-p-1  phBB^Pi  P"2 ATP5  +  P2  AP'^j  ‘ 

Hence  the  condition  of  Theorem  1  can  be  easily  checked. 

Recall  that  condition  (12)  is  equivalent  to  (13).  This  implies  that  there  is  a  p*  >  0  such  that 
£(p,p)  is  contractive  invariant  if  and  only  if  p  <  p*  ■  Therefore,  the  maximum  value  p*  can  be 
obtained  by  checking  the  condition  of  Theorem  1  bisectionally. 

For  systems  with  multiple  inputs,  we  may  diyide  the  state  space  into  cones:  x  Pbi  <  0  (>  0, 

or  =  0),  and  check  the  maximum  value  of 

m 

V(x)  =  xT(ATP  +  PA)x  -  2^2xTPbiSign(bJPx) 

2=1 

within  each  cone.  For  example,  consider  m  =  2,  the  surface  of  the  ellipsoid  £{P,p)  can  be 
divided  into  the  following  subsets: 

Sx  =  {x  e  Rn  :  bJPx  =  0,  bT2Px  >  0,  xTPx  =  p)  ,  -Su 

52  =  {x  G  Rn  :  bJPx  >  0,  blPx  =  0,  xTPx  =  p}  ,  -S2, 

53  =  {x  G  Rn  :  bJPx  >  0,  5jPx  >  0,  xTPx  =  p}  ,  -S3, 

SA  =  {x  G  Rn  :  b^Px  >  0,  b2Px  <  0,  xTPx  =  p}  ,  -54. 

With  this  partition,  £(P,p)  is  contractive  invariant  if  and  only  if 

maxF(x)  <  0,  maxV(x)  <  0,  (21) 

x€Si  v  ’  xes2 

and  all  the  local  extrema  of  V  (x)  in  S3  and  S4  are  negative. 

In  Si, 

V{x)  =  xT(ATP  +  PA)x  -  2 xrPb2. 
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Let  1 V  G  Rnx(n_1)  be  a  matrix  of  rank  n  -  1  such  that  bJPN  =  0,  i.e.,  {IVy  :  y  €  Rn  x}  is  the 
kernel  of  bjP.  The  constraint  bJPx  =  0  can  be  replaced  by  x  =  Ny,  y  6  Rn_1-  Thus, 

max  V (a;)  =  max  {yTl\Tr(ATP  +  PA)Ny  —  2yTiVTP62  : 

blPNy  >  0,  yTNTPNy  =  p}  . 

This  is  similar  to  the  optimization  problem  (18)  in  the  proof  of  Theorem  1  except  with  a  reduced 
order.  The  second  optimization  problem  in  (21)  can  be  handled  in  the  same  way. 

In  S3, 

V(x)  =  xT(ATP  +  PA)x  -  2xTP(bi  +  b2). 

All  the  local  extrema  of  V(x)  in  S3  (and  in  SA)  can  be  obtained  like  those  of  g(x)  in  the  proof 
of  Theorem  1. 

2.2  Saturated  High  Gain  Feedback 

With  the  bang-bang  type  control  law  (7),  V(x)  of  the  closed-loop  system  will  decrease  with 
a  maximal  convergence  rate.  As  we  have  noted  in  Section  2.1,  the  discontinuity  of  the  bang- 
bang  control  law  may  cause  the  state  equation  to  have  no  solution.  When  the  control  law  is 
implemented  on  a  sampled-data  system,  it  may  cause  frequent  switching  (chattering)  around 
the  switching  surface.  In  this  section,  we  will  replace  the  bang-bang  control  law  with  a  saturated 
high  gain  linear  feedback  at  the  cost  of  a  slight  reduction  in  convergence  rate.  We  also  start 
with  the  single  input  case. 

Theorem  2  Assume  that  m  =  1.  Suppose  that  £{P,p )  can  be  made  contractive  invariant  with 
a  bounded  control  If 

(A  -  k0BBrP)rP  +  P(A  -  k0BBTP )  <  0,  (22) 

then  £{P,p)  is  contractive  invariant  under  the  saturated  linear  control 

u  =  —sat  (kBrPx), 


for  all  k  >  ko. 

This  theorem  says  that  the  saturated  linear  control  u  =  —sat (kBTPx)  can  produce  the  same 
invariant  set  as  the  bang-bang  control  law  as  long  as  (22)  is  satisfied  and  k  >  k0.  As  has  been 
pointed  out  in  Proposition  1,  there  always  exists  a  k  >  0  satisfying  (22)  under  the  condition 
that  £{P,p)  can  be  made  contractive  invariant.  So  the  invariance  of  £{P,p)  does  not  require 
high  gain  feedback.  But  high  gain  is  necessary  for  achieving  fast  convergence  rate. 

Proof  of  Theorem  2.  Suppose  that  £(P,p)  can  be  made  contractive  invariant,  then  by  the 
equivalence  of  statements  a)  and  b)  in  Fact  1, 

xT(ATP  +  PA)x  -  2xrPBsign(BTPx)  <0,  V  r xe£(P,p)\  {0}.  (23) 
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If  \BTPx\  >  then 


sat(A:J9TPa;)  =  sign(PTPx). 


It  follows  from  (23)  that 

xr(ATP  +  PA)x  -  2xT  P  B  sat  (kBTPx)  <  0  (24) 

for  x  G  £{P,p)  \  {0}  such  that  |PTPa:|  > 

If  \BTPx\  <  then 

sat  (kBTPx)  =  kBTPx. 

Since  k  >  ko,  it  follows  from  (22)  that 

(A  -  kBBTP)rP  +  P(A  -  kBBrP )  <  0. 

Hence  we  also  obtain  (24).  This  shows  that  £{P,p)  is  contractive  invariant  under  the  control 

u  =  —sat(kBTPx). 


□ 


Let  us  now  compare  the  convergence  rates  under  the  two  controls 

u  =  -sat  (kBTPx) 


and 


u  —  —sign  (BTPx). 


The  difference  between  the  two  F(x)’s  under  these  two 


|2®tPP  (sign(PTPa:)  -  s&t{kBrPx)^j  | 


controls  is 

=  0, 

if  \BTPx\  >  i, 

4 

if  |PTPx|  <  i. 

Note  that  |sign(PTPx)  -  sat{kBTPx)\  <  1.  By  letting  k  -»•  oo,  the  difference  between  the  two 
V^aO’s  will  go  to  zero  uniformly  on  £(P,p).  Thus  we  can  say  that  saturated  high  gain  linear 
feedback  will  produce  sub-optimal  convergence  rate. 

We  now  consider  the  multiple  input  case.  For  v  €  Rm,  denote 


IT 

Here,  as  usual,  we  have  slightly  abused  the  notation  by  using  sat  to  denote  both  the  scalar  and 
the  vector  saturation  functions.  We  have  the  following  result. 


Theorem  3  For  a  multiple  input  system,  suppose  that  £(P,p)  can  be  made  contractive  invariant 
with  a  bounded  control,  then  there  exists  a  k  >  0  such  that  £(P,p)  is  contractive  invariant  under 
the  control 

u  =  —sat  (kBrPx). 
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(25) 


Proof.  The  condition  that  £(P,  p)  can  be  made  contractive  invariant  implies  that 

m 

xT{ATP  +  PA)x  -2  Y,  xTPbisign{bjPx)  <  0,  V  x  G  S(P9  p)  \  {0}. 

t=l 

We  need  to  show  that  there  exists  a  k  >  0  such  that 

m 

xT{ATP  +  PA)x  -  2  Y,  x^PbiS^kbJPx)  <0,  V  x  £  £(P,  p)  \  {0}.  (26) 

t=i 


First,  we  will  show  that  (26)  is  equivalent  to 


m 

xT(ATP  +  PA)x  -  2  xTPbisa.t(kbJPx)  <0,  V  x  €  d£(P,  p).  (27) 

i=l 


If  this  is  true,  then  we  only  need  to  consider  x  G  d£(P,p).  Obviously,  (27)  is  implied  by  (26). 
We  need  to  prove  the  converse. 

Suppose  that  x  G  d£(P,p)  satisfies  (27).  For  7  >  0,  define 


g{1)=xT(ATP  +  PA)x 


2f>Tp6*Sat(fc^PTC'~ 

.—1  ”7 


> 


then  g{  1)  <  0.  Since 


and 


S&tjkbJ  P'jx) 


xrPbiSSLt{kbJPx)  >  0 

decreases  as  7  increases,  it  follows  that  g( 7)  increases  as  7  increases.  Hence, 

5(7)  <  5(1)  <  (0>  !]• 


Therefore,  for  all  7  G  (0, 1], 

m 

(7 x)T(ATP  +  PA)(jx)  -  2  ^2{jx)TPbisat(kbJP'Yx)  =  7^(7)  <  0. 

i=l 


This  shows  that  (26)  is  implied  by  (27). 
Let 


xed£(P,p) 


e  =  —  max  ^xt(j4tP  +  PA)x  —  2  ^  xT  Pbisign(bJ  Px) 


1=1 


Then,  from  (25),  we  have  e  >  0.  For  all  x  G  d£(P,p), 

m 

xT(ATP  +  PA)x  -  2  Y,  xTpbi  sat  (kbJPx) 

i= 1 

m  m  v 

=  xT(ATP  +  PA)x  -  2  xTPbisign(bJPx)  +  2  £  zTP&;  (sign(6?Ps)  -  sat{kbjPx) J 

i=l  *=1 

m  . 

-e  +  2  £  *TP6*  (signf&fPs)  -  sat(fc67px)J  .  (28) 


< 


i=l 
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Since 


xTPbi  (sign (bJPx)  —  sat (kbJPx)^ 


=  0,  if  \bJPx\  >  -, 

<p  «IW<p 


we  have 


< 


2m 


2  ^  xTPbi  (sign {bJPx)  -  sa.t(kbj Pxfj 
i- 1 

If  we  choose  k  >  then  from  (28), 

m 

xr(ATP  +  PA)x  -  2  Y,  xTPbiSa.t(kbJPx)  <0,  V  x  €  dS(P,  p), 

i=  1 

which  is  (27).  It  follows  from  the  equivalence  of  (26)  and  (27)  that  £ ( P \  p)  is  contractive  invariant 
under  the  control 

u  =  —  s&t(kBTPx). 

□ 


Example  1  Consider  the  system  (6)  with 


0.6  -0.8 

0.8  0.6  ’ 


Let 


0.0836  -0.0639 

-0.0639  0.1460 


By  checking  the  condition  of  Theorem  1  bisectionally,  the  largest  ellipsoid  that  can  be  made 
contractive  invariant  with  a  bounded  control  is  £(P,p*)  with  p*  =  1.059.  By  using  the  design 
method  in  [11],  a  feedback 


u  =  sat^o®),  Fo  =  [  0.0036  —0.3057  j 


is  found  such  that 

{A  +  BF0)TP  +  P{A  +  BF0)  <  0, 
with  £(P,p ),  p  =  1.058  inside  the  linear  region  of  the  saturation 

£{F0)  =  {xeR2:  l-Fo^loo  <  l} 

(see  Fig.  1).  The  eigenvalues  of  A  +  BF0  are  -0.0078  ±  j0.8782.  It  can  be  expected  that  the 
convergence  rate  under  this  feedback  is  very  slow.  The  convergence  rate  is  accelerated  by  using 
a  saturated  high  gain  feedback 

u  =  —sat  (5  BTPx). 

This  is  illustrated  in  Figs.  1  and  2.  In  Fig.  1,  represents  the  initial  state,  the  solid  trajectory 
is  under  the  control  of  u  =  sat(F0x)  and  the  dash-dotted  one  is  under  the  control  of  u  = 
— sat(5f?TPa;).  Fig.  2  shows  V{x)  =  xTPx  as  a  function  of  time.  Also,  the  solid  one  is  under 
the  control  of  u  =  sat(Fo^)  and  the  dash-dotted  one  is  under  the  control  of  u  =  -sat(5 B^Px). 
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Figure  1:  Comparison  of  the  trajectory  convergence  rates. 


Figure  2:  Comparison  of  the  convergence  rates  of  xrPx. 

From  Fig.  2,  we  see  that  the  decrease  of  xTPx  becomes  slower  and  slower  under  the  control 

u  =  —sat  (5  BTPx). 

This  will  be  the  case  even  if  we  increase  the  gain  k  in 

u  =  —sat  (kBTPx) 

to  infinity.  Actually,  the  overall  convergence  rate  under  the  bang-bang  control 

m  =  —  sign(6fP:r),  i  =  1,2, 

is  limited  by  the  shape  of  the  ellipsoid  or  the  matrix  P.  This  problem  will  be  discussed  in  the 
next  section. 
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2.3  Overall  Convergence  Rate 

We  now  consider  the  system  (8)  under  the  maximal  convergence  control, 

m 

x  =  Ax  -  sign  (bJPx).  (29) 

2=1 

Assume  that  £(P,p)  is  contractive  invariant  for  (29).  We  would  like  to  know  the  overall  con¬ 
vergence  rate  in  £(P,p).  We  will  see  later  that  as  p  decreases  (note  that  a  trajectory  goes  into 
smaller  £(P,p )  as  time  goes  by),  the  overall  convergence  rate  increases  but  is  limited  by  the 
shape  of£(P,p).  This  limit  can  be  raised  by  choosing  P  properly. 

The  overall  convergence  rate,  denoted  by  ct,  is  defined  by  (5)  in  Section  1.  Here  we  would 
like  to  examine  its  dependence  on  p,  so  we  write, 

o(p):=^min|-^y:  *e5(P,p)\{0}j. 

The  main  results  of  this  subsection  are  contained  in  the  following  theorem. 


Theorem  4 


,  ,  1  .  f  V(x)  T„  1 

a(p)  =  -  mm  <j - y-  :  xLPx  =  p  j  ; 

b)  a(p )  increases  as  p  decreases; 

c)  Let 

p0  =  min  {  -  xr(ArP  +  PA)x  :  xTPx  =  1,  xTPB  =  o}  , 

then , 

S“W  =  T- 


Proof. 

a)  Consider  x  €  d£(P,  p)  and  k  €  (0, 1], 

^(fcz)  _  k‘2xT(ATP  +  PA)x  -  2k  E™  i  x^Pbj  sign {£[Pkx) 
V{kx )  _  k2xTPx 

—xT(ATP  +  PA)x  +  |  YaLi  xrPbj  sign(bJPx) 

~  xTPx 


(30) 


(31) 


(32) 


Since 


in 

y  xrPbj  sign  {bJPx)  >  0, 


t=l 


increases  as  k  decreases.  It  follows  that  the  minimal  value  of  is  obtained  on  the 

V(kx)  '  ' 


boundary  of  £(P ,  p),  which  implies  (30) 
b)  This  follows  from  the  proof  of  a). 
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c)  Prom  a),  we  see  that 


.  {—x£[A^P+PA)x+2  YL'iLi  xTPbi  sign(6jP2r)  _  Tp  \ 
Mp)  =  -n( - * - - - x  rx-pj 

=  min  |  -  xT(ATP  +  PA)x  +  ^  S  xTpbi  siS AbIPx) :  xTpx  =  X| 
<  min  xT(ATP  +  PA) 

-  min  |  -  xT(ATP  +  PA)x  :  xTPx  =  1,  xTPB  =  o| 


o  m  _ 

\x  +  —  ^  x^Pbi  sign(bJPx)  :  xrPx  =  1,  x  PB  =  0 


=  Po- 


It  follows  then  2 a{p)  <  Po  for  all  p  >  0.  To  prove  (31),  it  suffices  to  show  that  given  any  e  >  0, 
there  exists  a  p  >  0  such  that 

Mp)  >Po~e. 


Denote 


and 


It  is  clear  that 


A^o  =  jx  €  Rn  :  xTPx  =  1,  xrPB  =  oj  , 
X{5)  =  {x  €  Rn  :  xTPx  -  1,  \xTPB\oo  <  <i}  . 


lim  dist(A'(5),  Xo)  —  0, 
i-+o 


where  dist(-,-)  is  the  Hausdorff  distance1.  By  the  uniform  continuity  of  xT(ArP  +  PA)x  on  the 
surface  {x  e  Rn  :  xTPx  =  1},  we  have  that,  given  any  e,  there  exists  a  <5  >  0  such  that 

(33) 


min  {  -  xT(.4TP  +  PA)x  :  xTPx  =  1,  |xTPB|co  <  $}  >  Po  -e. 


Since 


we  have, 


^  xxPbi  siga(bjPx)  >  0, 
»=i 


min  {-xT(,4TP  +  PA)x  +  Pbi ^(PjPx)  :  xTPx  =  1,  | xxPB\^  <S\>p0-e 

1  vPi= i  } 


(34) 


for  all  p  >  0. 


:Let  X\  and  X2  be  two  bounded  subsets  of  Rn.  Their  Hausdorff  distance  is  defined  as 

dist(A'i,  X2)  :=  max{d{XuX2),d{X2iXi)}  , 

where 


d(X  1,^2)=  sup  inf  |xi-ar2|. 

x1eXlx2&X2 


Here  the  vector  norm  used  is  arbitrary. 
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Let  . 

ft  =  min  |  -  xT(ATP  +  PA)a:  :  xTPx  =  1,  |:rTPP|oo  >  <*}  • 

If  ft  >  ft  -  e,  then  for  all  p  >  0, 

j-a:T(ATP  +•  Pj4)®  +  -^=  Y^xTPbiSign(bJPx)  :  xTFx  =  1,  |xTPF|oo  >  <*J 


min 

>  ft  >  ft  -  e- 

Combining  the  above  with  (34),  we  have 


2«(p)  =  min  rrT(ylTP  +  PA)x  +  sigft&JPz) :  xTPi  =  1 J 


>  ft  ~  £• 

for  all  p  >  0.  This  shows  that 

2a(p)  >  ft  -  e,  Vp  >  0. 

If  ft  <  ft  —  £,  then  for  x  2 


(35) 


we  have 


mm 


|— XT(i4TP  +  Pj4)z  +  xTpbi  S'&n(bi  PX)  1  xTPx  =  lafT-PJ5loo  >  j 


>ft  + 


26 


Vp 
>  ft  -  £• 

Combining  the  above  with  (34) ,  we  also  obtain  (35)  and 

2or(p)  >  ft  -  e 


for  (  26  \ 2 

P<  l -ft  +  ft- J 

This  completes  the  proof.  D 

Theorem  4  says  that  a(p)  can  be  obtained  by  computing  the  maximum  of  V(x)  over  d£(P,  p). 
For  the  single  input  case,  Theorem  1  provides  a  method  for  determining  if  this  maximum  is 
negative.  The  exact  value  of  a(p)  can  be  computed  with  a  procedure  similar  to  the  proof  of 
Theorem  1.  To  avoid  too  much  technical  detail,  we  assume  for  simplicity  that,  for  any  real 
eigenvalue  A j  of  A  +  P~1ATP,  there  exists  no  x  satisfying 

(PA  +  ATP  -  A jP)x  =  PB. 
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This  is  the  case  if  {A  +  P-1ATP,B )  is  controllable,  thus  the  assumption  is  generally  true.  Let 
Xu  A2,  •  •  - ,  \j  be  real  numbers  satisfying  (14)  and  (15).  Denote 

ft  =  -A,  +  -PTP(ATP  +  PA-  XjPy'PB, 

3  P 


then, 


a{p)  =  |  min  { ft  :  j  =  0, 1,  •  •  • ,  j}  , 


where  ft  is  35  defined  in  Theorem  4. 

Since  the  overall  convergence  rate  is  limited  by  ft/2  and  it  approaches  this  limit  as  p  goes 
to  0,  we  would  like  ft  not  to  be  too  small.  For  a  fixed  P,  a  formula  for  computing  ft  can  be 
derived  directly  from  the  definition.  Let  the  kernel  of  BTP  be  {Ny  :  y  G  R  }•  Then 


ft  =  -Amax  ((NTPN)-1NT(ATP  +  PA)n)  .  (36) 

Since  N  depends  on  P,  the  above  formula  gives  us  no  hint  for  choosing  P  to  obtain  a  satisfactory 
ft.  The  following  proposition  will  lead  to  an  LMI  approach  to  choosing  P. 


Proposition  2 

ft  =  sup  A 
F 

s.t.  {A  +  PF)TP  +  P(A  +  BF)  <  -A P. 

Proof.  Notice  that,  for  any  P,  we  have 

xT{{A  +  BF)TP  +  P{A  +  BF))x  =  xT(ATP  +  PA)x,  V  xTPB  =  0. 


(37) 


It  follows  that 

ft  =  min  {  -  sT((A  +  BF)TP  +  P(A  +  BF))x  :  xTPx  =  1,  xTPP  =  o} 
>  min  {  -  xT((A  +  BFfP  +  P(A  +  BF))x  :  xTPx  =  l}  , 


and  hence, 


>  sup  min 
F 


{  -  xT((A  +  BF)rP  +  P{A  +  BF))x  :  xrPx  =  l}  . 


(38) 


(39) 


In  what  follows,  we  will  prove  that 

ft  =  sup  min  {  -  *T((A  +  BF)TP  +  P(A  +  BF))x  :  xTPx  =  l}  . 

F  1 

In  view  of  (38),  it  suffices  to  show  that  for  any  e  >  0,  there  exists  an  P  =  -kBTP,  with  k  >  0, 

such  that  ^ 

min  {  -  sT((A  +  PP)TP  +  P(A  +  BF)): x  :  xTPx  =  1  j  >  ft  -  e. 


(40) 
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Prom  the  definition  of  fo,  we  see  that  there  exists  a  6  >  0  such  that 

min  {  -  xT{ArP  +  PA)x  :  xTPx  =  1,  \xTPB\2  <  s)  >  Po  -  £ 

(refer  to  (33).  Since  xTPBBTPx  >  0, 

{  -  xT((A  -  kBBTP)TP  +  P(A  -  kBBrP))x  :  xTPx  =  1,  \xTPB\  <  <$} 


mm  • 

>  Po  ~  £> 


(41) 


for  all  k  >  0. 

For  every  x  G  R71, 

-rrT((A  -  kBBTPfP  +  {A  -  kBBTP))x 

is  an  increasing  function  of  k.  Similar  to  the  proof  of  Theorem  4,  it  can  be  shown  that  there 
exists  a  k  >  0,  such  that 


min  {  -  xT((A  -  kBBTP)TP  4-  P(A  -  kBB^P^x  :  xTPx  =  1,  \xTPB\  >  <i} 

>  A)  ~  £• 


(42) 


Combining  (41)  and  (42),  we  have 

min  {  -  a;T((A  -  kBBTP)rP  +  P{A  -  kBBTP))x  :  xTPx  =  l} 
>po~e. 


This  proves  (40)  and  hence  (39). 

Denote  . 

p(F)  =  min{  -  sT((A  +  BF)TP  +  P{A  +  BF))x  :  xTPx  =  1}  . 

From  (39),  we  have 

p0  =  sup  P{F). 

F 


It  can  be  shown  that 

P(F)  =  max  {A  :  (A  +  BF)TP  +  P(A  +  BF)  <  - XP }  • 

.  .  □ 

This  brings  us  to  (37). 

For  a  fixed  P,  Pa  is  a  finite  value  given  by  (36).  Assume  that  (A,  B)  is  controllable,  then  the 
eigenvalues  of  (A  +  BF)  can  be  arbitrarily  assigned.  If  we  also  take  P  as  a  variable,  then  ~Pq/2 
can  be  made  equal  to  the  largest  real  part  of  the  eigenvalues  of  A  +  BF  (see  the  definition, 
as  given  in  Section  1,  of  the  overall  convergence  rate  for  a  linear  system).  This  means  that  p0 
can  be  made  arbitrarily  large.  But  generally,  as  p0  becomes  very  large,  the  matrix  P  will  be 
badly  conditioned,  i.e.,  the  ellipsoid  S(P,  p)  will  become  very  thin  in  certain  direction,  and  hence 
very  “small”,  with  respect  to  a  fixed  shape  reference  set.  On  the  other  hand,  as  mentioned  in 
[11,  10],  if  our  only  objective  is  to  enlarge  the  domain  of  attraction  with  respect  to  a  reference 
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set,  some  eigenvalues  of  A  +  BF  will  be  very  close  to  the  imaginary  axis,  resulting  in  very  small 
(30.  These  two  conflicting  objectives  can  be  balanced,  for  example,  by  pre-specifymg  a  lower 
bound  on  p0  and  then  maximizing  the  invariant  ellipsoid  with  respect  to  some  shape  reference 
set.  This  mixed  problem  can  be  described  as  follows. 

sup  a  (43) 

P>0,p,F,H 

s.t.  a)  aX r  C  £{P,p), 

b)  (A  +  BF)rP  +  P(A  +  BF)  <0, 

c)  £(P,p)  C  C(F), 

d)  (A  +  BHfP  +  P{A  +  BE )  <  -pP, 

where  *R  is  a  shape  reference  set  (see  [9, 10,  11]).  The  constraint  a)  means  that  £(P,  p)  contains 
By  maximizing  a,  £{P,p)  will  be  maximized  with  respect  to  XR.  The  constraints  b)  and 
c)  guarantee  that  £(P,p)  can  be  made  contractive  invariant  and  the  constraint  d)  guarantees  a 
lower  bound  p  on  the  convergence  rate.  This  optimization  problem  can  be  transformed  into  one 
with  LMI  constraints  as  those  in  [9,  10,  11].  By  solving  (43),  we  obtain  the  optimal  ellipsoid 
£(P,p)  along  with  two  feedback  matrices  F  and  H.  We  may  actually  discard  both  F  and  H 
but  instead  use  the  bang-bang  control  law 

m  —  —  sign^Pz),  i  =  1, 2,  •  •  • ,  m,  (44) 

or  the  high  gain  controller 

Ui  =  -sat  (kbjPx),  i  =  1, 2,  •  •  • ,  m.  (45) 

The  final  outcome  is  that  under  the  control  of  (44)  or  (45),  the  closed-loop  system  will  have  a 
contractive  invariant  set  £(P,p)  and  a  guaranteed  limit  of  the  convergence  rate 

Po>£_ 

2  ~  2  ' 

2.4  Maximal  Convergence  Control  in  the  Presence  of  Disturbances 

Consider  the  open-loop  system 

x  =  Ax  +  Bu  +  Ew,  z  €  R ",  Rm,  w<EHg,  (46) 

where  u  is  the  control  bounded  by  Moo  <  1  and  w  is  the  disturbance  bounded  by  Moo  <  1-  We 
also  consider  the  quadratic  Lyapunov  function  V{x )  =  xTPx. 

Along  the  trajectory  of  the  system  (46), 

V{x,u,w)  =  2xTP(Ax  +  Bu  +  Ew) 

m 

=  xT{ATP  +  PA)x  -h  2  xTPbiUi  -h  2 xTPEw. 
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No  matter  what  w  is,  the  control  that  maximizes  the  convergence  rate,  or  minimizes  V(x,u,w), 
is  also 

m  = -sign(bJPx),  i  =  l,2,  (47) 

Under  this  control,  we  have 

m 

V{x,  w )  =  xr(ArP  +  PA)x  -  2  xTPbi  sign{bjPx)  +  2 xTPEw.  (48) 

2=1 

Now  consider  the  closed-loop  system 

m 

x  =  Ax  —  ^2  bisign(bJPx)  +  Ew.  (49) 

2=1 

An  ellipsoid  £(P,p)  is  invariant  for  the  system  (49)  if  V(x,w)  <  0  for  all  possible  w  bounded 
by  | to  |oo  <  1-  Unlike  the  system  in  the  absence  of  disturbance,  this  system  does  not  possess 
the  property  of  contractive  invariance.  We  may  define  strict  invariance  as  in  [11].  Since  the 
invariance  property  can  be  easily  extended  to  the  strict  invariance  property  (e.g.,  by  changing 
“<”  to  “<”)>  we  will  only  investigate  the  former. 

Denote  the  ith  column  of  i?  as  e*.  Prom  (48),  we  see  that,  for  x  6  R",  the  worst  w  that 

maximizes  V(x,u>)  is 

Wi  =  sign(eJPx),  i  —  1,2,  •••,?• 

Thus,  we  have  the  following  obvious  fact. 

Fact  2  The  following  three  statements  are  equivalent: 

a)  The  ellipsoid  £{P,  p)  can  be  made  invariant  for  (46)  with  a  bounded  control Ju|oo  <  1/ 

b)  The  ellipsoid  £{P,p)  is  invariant  for  (49) ; 

c)  The  following  condition  is  satisfied, 

972  9 

xT{AT P  +  PA)x  -  2  52  xTPbisign(bJPx)  +  xTPeiS\gn(ejPx)  <0,  Vrr  G  d£{P, p). 

i=l  i=l 

Denote 

m  9 

U(s)  =  xT(A'IP  +  PA)x  -  2  52  xTPbiSign{bJPx)  +  2  £  xTPeisign{eiPx). 

»=i  *'=i 

Fact  2  says  that  £{P,p)  is  invariant  for  (49)  if  and  only  if  V(x)  <  0  for  all  x  G  d£(P,p).  In  the 
following,  when  we  say  that  £(P,p)  is  invariant,  we  mean  it  is  invariant  for  the  system  (49),  or 
for  the  system  (46)  under  the  control 

m  =  -sign  (bJPx). 
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Proposition  3  Suppose  that£{P,pi)  and£(P,p2 )  are  both  invariant  and  p i  <  p2.  Then£(P,p) 
is  invariant  for  all  p  G  [pi ,  P2]  - 

Proof.  For  a  fixed  x  €  Rn,  consider  V(kx),  k  >  0,  as  a  function  of  k.  Clearly,  this  is  a  quadratic 
function  and  we  also  have  F(0x)  =  0.  Hence,  if  both  V{hx)  and  V(k2x)  are  negative,  we  must 
have  V(kx)  negative  for  all  k  between  h  and  k2.  The  result  of  the  proposition  follows  readily 

from  this  argument. 

From  Proposition  3,  we  see  that  all  the  p  such  that  £(P,  p)  is  invariant  form  an  interval.  By 
Fact  2,  this  is  the  largest  interval  we  can  achieve  with  any  feedback  control  constrained  by  the 
input  saturation.  In  other  words,  the  maximal  convergence  control  produces  both  the  maximal 
invariant  ellipsoid  and  the  minimal  invariant  ellipsoid.  As  we  have  mentioned  in  [11],  a  large 
invariant  ellipsoid  is  desired  for  a  large  domain  of  attraction,  and  a  small  invariant  ellipsoid 
indicates  a  good  capability  of  disturbance  rejection.  In  summary,  the  maximal  convergence 
control  is  ideal  for  dealing  with  disturbances. 

Similar  to  the  system  in  the  absence  of  disturbance,  it  can  be  shown  that  the  saturated  high 
gain  feedback 

u  =  —sat  (kBTPx) 

can  be  used  to  approximate  the  bang-bang  control 

m  =  -sign(&?  Px),  i  —  1, 2,  •  •  •  ,m, 


and  to  produce  a  sub-optimal  disturbance  rejection  performance. 

The  condition  in  Fact  2  c)  can  be  verified  by  solving  a  set  of  optimization  problems.  Consider 
the  single  input  and  single  disturbance  case,  m  =  q  =  1.  In  this  case,  we  have 

V{x)  =  xT(ATP  +  PA)x  -  2xTPPsign(BTPx)  +  2xTPPsign(ETPx). 

Similar  to  the  two-input  case  in  Section  2.1,  we  can  divide  the  surface  d£(P,p)  into  8  subsets: 

Sx  =  {x  G  Rn  :  BTPx  =  0,  ETPx  >  0,  xTPx  =  p)  ,  -Su 

■  S2  =  {x  €  Rn  :  BTPx  >  0,  ETPx  =  0,  xTPx  =  p}  ,  - S2 , 

53  =  {x  G  Rn  :  BTPx  >  0,  ETPx  >  0,  xTPx  =  p}  ,  -S3, 

54  =  {x  <E  Rn  :  BrPx  >  0,  ErPx  <  0,  xTPx  =  p}  ,  -S4. 

With  this  partition,  £(P,p)  is  invariant  if  and  only  if 

max  V (x)  <  0,  m^cV(x)  <  0,  (50) 

xeSi 

and  all  the  local  extrema  of  V(x)  in  53  and  S4  are  non-positive.  These  optimization  problems 
can  be  handled  similarly  as  those  in  Section  2.1. 
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2.5  Extension  to  General  Lyapunov  Functions 

In  (5),  the  convergence  rate  is  defined  for  a  general  Lyapunov  function.  It  is  known  that  the 
quadratic  type  function  is  the  most  popular  and  the  simplest  to  deal  with.  In  some  special 
situations,  one  may  prefer  to  use  other  types  of  Lyapunov  functions.  However,  it  should  be 
expected  that  not  all  of  the  previous  results  can  be  extended  to  a  general  Lyapunov  function. 

Given  a  positive  definite  function  V(x),  assume  that  f  exists  and  is  continuous  in  R".  For 
p  >  o,  the  level  set  is  denoted  as  Lv{p).  Also  consider  the  system  (6).  Along  the  trajectory  of 

the  system  (6), 

VM  =  (^)  (Ax+Bu) 


Under  the  constraint  that  |t*|oo  <  1,  the  control  that  maximizes  the  convergence  rate,  or  mini¬ 
mizes  V(x,u),  is  a 

Ui  =  -sign  (V|Q  ,  i  =  (51) 

Under  this  control,  the  closed-loop  system  is 


i  =  Ar-f>i  Sn(^) 
2—1 


(52) 


It  is  clear  that  Fact  1  is  true  if  we  replace  the  ellipsoid  £(Ptp)  with  the  level  set  Lv(p)  and 
(9)  with 

i,<sig,i(!,i£)<0’  (53> 

Also,  the  bang-bang  control  (51)  can  be  replaced  with  a  continuous  one,  the  saturated  high 

gain  feedback,  f)V\ 

u  =  -sat 

to  achieve  a  sub-optimal  convergence  rate. 

For  the  system  (46)  subject  to  disturbance,  it  can  be  shown  with  similar  arguments  that  the 
bang-bang  control  (51)  will  also  maximize  the  convergence  rate  and  achieve  the  largest  invariant 

level  set.  , 

However,  for  those  results  that  involve  exact  characterization  of  the  maximal  invariant  ellip¬ 
soid  (Theorem  1)  and  the  maximal  convergence  rate  (Theorem  4),  they  cannot  be  extended  to 
a  general  Lyapunov  function. 

3  Discrete-time  Systems 


Consider  the  discrete-time  system 

x(k  +  l)  =  Ax(k)  +  Bu(k),  x  €  Rn,  u  e  Rm,  Moo  <  1- 


(54) 
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Assume  that  the  system  is  stabilizable  and  that  B  has  full  column  rank.  Given  V(x)  -  xTPx, 
we  would  like  to  maximize  the  convergence  rate  within  £(P,p)- 
Define 

AV(x,  u)  =  (Ax  +  Bu)rP(Ax  +  Bu)  -  xTPx. 

Our  objective  is  to  minimize  AV(x,u)  under  the  constraint  |u|oo  <  1  for  every  *  e  £(P>P)- 
Since  B  has  full  column  rank,  BTPB  is  nonsingular  and  we  have 

AF(z,u)  =  urBTPBu  +  2uTBrPAx  +  xTATPAx  -  xTPx 

=  (u  +  (BrPB)-lB'TPAxy  B'PB(u  +  (B'rPB)-1B'rPAx) 

—xrATPB(BTPB)~1BrPAx  +  xrA'rPAx  -  xTPx. 

Let 

F0  =  -(BTPB)'1BTPA. 

It  is  clear  that  the  convergence  maximization  problem  is  equivalent  to 

min  (u  -  F0xfBTPB(u  -  F0x).  (55) 

Moo<l 

Let  us  first  consider  the  single  input  case.  In  this  case,  the  control  that  maximizes  the 
convergence  rate  is  simply, 

u  =  sat(Fo*).  (56) 

This  control  is  continuous  in  rtr,  so  it  is  better  behaved  than  its  continuous-time  counterpart. 
Consider  the  closed-loop  system 

x(k  +  1)  =  Ax(k)  +  Bsa.t(F0x).  (57) 

The  system  is  asymptotically  stable  at  the  origin  if 

(A  +  BF0)rP(A  +  BFq)  -  P  <  0, 

^  _  B{BrpB)^B^PAy  p(a-  B(BtPB)~1BtPA^  -P<  0.  (58) 

As  in  the  continuous-time  case,  we  also  have 
Fact  3  For  the  single  input  case ,  the  following  two  statements  are  equivalent 

a)  The  ellipsoid  £(P,p)  can  be  made  contractive  invariant  for  the  system  (54)  with  a  bounded 
control; 

b)  The  ellipsoid  £(P,p)  is  contractive  invariant  for  (57),  i.e.,  the  following  condition  is  sat- 
isfied , 

(Ax  +  Bsa.t(F0x))TP(Ax  +  Bsa.t(F0x))  -  xTPx  <0,  x  G  £(P,  p)  \  {0}.  (59) 
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Proposition  4  For  the  single  input  case,  the  ellipsoid  £ (P,  p)  can  be  made  contractive  invariant 
for  some  p  >  0  if  and  only  if  (58)  is  satisfied. 

Proof.  There  exists  a  po  >  0  such  that 

£(P,p0)c{x€Hn:  |F0*|oo<l}. 

Suppose  that  (58)  is  satisfied.  Let  u  =  sat(F0®),  then  u  =  F0x  for  x  G  £(P,po)-  Hence 
£(P,  po)  is  contractive  invariant  under  u  —  sat(J5ba:). 

On  the  other  hand,  suppose  that  £(P,  p)  can  be  made  contractive  invariant.  By  Fact  3,  we 
have  (59).  Let  Pl  =  min{p0,p},  then  sat (F0x)  =  F0x  for  x  G  £(P,Pi).  It  follows  from  (59)  that 

(58)  is  true.  D 

Suppose  that  (58)  is  satisfied,  we  would  like  to  obtain  the  condition  for  £(P,  p)  to  be  invariant 
for  (57)  and  to  find  the  largest  p  such  that  £{P,p)  is  invariant. 

Because  of  (58),  we  have 

(Ax  +  Bs&t(F0x))TP(Ax  +  Bsat(jF0a;))  -  xTPx  <  0 

for  all 

x  G  [x  G  Rn  :  |F0*|  <l,a^0}  =  {iGRn:  \BTPAx\  <  BrPB,  x  ±  o}  • 

Hence,  £  (P,  p)  is  invariant  if  and  only  if 

(Ax  -  B)TP(Ax  —  B)  —  xTPx  <  0, 

\Jx  G  £(P,  p)  such  that  BTPAx  >  BTPB.  (60) 

Like  the  equivalence  of  (12)  and  (13),  it  can  be  shown  that  (60)  is  equivalent  to 

(Ax  -  B)TP(Ax  -  B)  -  xTPx  <  0, 

\/x  G  d£(P,  p)  such  that  BrPAx  >  BrPB.  (61) 


And  we  have 

Theorem  5  For  the  single  input  case,  assume  that  (58)  is  satisfied.  Let  Ai,  A2, •  •  •  , >  1  be 
real  numbers  such  that 


A jP  -  ArPA  P 

p-1ATPBBTPA  XjP  —  ATPA 


=  0 


(62) 


and 

BTPA(ATPA  -  A jP)~1ATPB  >  BTPB. 
Then,  £(P,p)  is  contractive  invariant  for  the  system  (57)  if  and  only  if 


(A j  -  l)p  -  BTPA(ATPA  -  A jP)~1ATPB  +  BTPB  <  0, 
Vj  =  l,2,--J. 


(64) 


If  there  is  no  A j  >  1  satisfying  (62)  and  (63),  then  £(P,p)  is  contractive  invariant. 
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Proof.  Denote 


g(x)  =  (Ax  -  B)TP(Ax  -  B)  -  xrPx. 

On  the  plane  BTPAx  =  BTPB,  we  have 

Ax  -  B(BTPB)~1BTPAx  —  Ax  -  B. 

Since  P  satisfies  (58),  we  have  g(x)  <  0  for  all  x  on  the  plane  BrP Ax  =  BTPB.  So  the  invariance 
of  £(P,p)  is  equivalent  to  that  all  the  extrema  in  the  surface  xTPx  =  p,BTPAx  >  BTPB,  if 
any,  are  less  than  zero. 

Suppose  that  x  is  an  extremum  in  the  surface,  then  by  Lagrange  multiplier  method,  there 
exists  a  real  number  A  such  that 

(ATPA  -  \P)x  =  ATPB,  xTPx  =  p,  BTPAx>BTPB.  (65) 


At  the  extremum,  we  have 


g(x)  =  (A  -  l)p  -  BTPAx  +  BrPB. 


Since  BTPAx  >  BTPB,  we  have  g(x)  <  0  for  A  <  1.  So  we  only  need  to  consider  A  >  1.  Assume 


ATPB  = 


and  partition  ATPA  and  P  accordingly  as 


ATPA  = 


Ql  Ql2 

Q 12  92 


Pi  Pl2 

Pi 2  P2  ' 


It  follows  from  (58)  that  Qi  -  Pi  <  0  and  Qi  -  APi  <  0  for  all  A  >  1.  It  can  be  shown  as  in 
the  proof  of  Theorem  1  that  (ATPA  -  \P)x  =  ATPB  and  A  >  1  imply  that  ATPA  -  A P  is 
nonsingular.  Hence 

X  =  (ATPA  -  \P)~1ATPB, 

and  from  xTPx  =  p, 

BtPA(AtPA  -  A P)~1P(ATPA  -  A P)~lArPB  =  p. 

The  rest  of  the  proof  is  similar  to  that  of  Theorem  1.  □ 

The  supremum  of  p  such  that  £  (P,  p)  is  contractive  invariant  can  be  obtained  by  checking 
the  condition  in  Theorem  5  bisectionally. 

Let  us  now  consider  the  multiple  input  case  and  examine  the  optimization  problem  (55).  If 
BTPB  is  diagonal,  then  we  also  have 


u  =  sat(Pox), 
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as  the  optimal  control.  But  for  the  general  case,  the  optimal  u  cannot  be  put  into  this  simple 
form.  Actually,  (55)  is  a  minimal  distance  problem.  Let 

v  =  F0x  =  -{BTPB)~1BTPAx, 

then  the  optimization  problem  is  to  find  a  point  in  the  box  |zz joo  <  1  that  is  closest  to  v,  with 
the  distance  induced  by  the  weighted  2-norm,  i.e., 

|u  -  v\btpb  =  (( u  -  v)TBTPB(u  -  u))5  . 

This  is  illustrated  in  Fig.  3.  In  Fig.  3,  v  is  marked  with  “o”  and  the  optimal  u  is  marked  with 
Suppose  that  v  6  R2  is  outside  of  the  unit  square,  then  there  exists  a  smallest  ellipsoid 


Figure  3:  Illustration  for  the  relation  between  v  and  the  optimal  u. 


centered  at  v, 

£0  =  [u  e  R2  :  (u  -  v)TBTPB(u  -v)<  r2}  , 

which  includes  a  point  of  the  unit  square.  Since  the  unit  square  is  convex  and  So  is  strictly 
convex,  they  have  a  unique  intersection,  which  is  the  optimal  u. 

For  the  case  m  =  2,  the  solution  can  be  put  into  an  explicit  formula.  For  simplicity,  let 


BTPB  = 


a  —c 
— c  b 


and  assume  that  c  >  0.  We  partition  the  plane  into  9  regions  (see  Fig.  3,  where  the  regions  are 
divided  by  the  dash-dotted  lines): 


Rq  = 

{v  €  R2 

Ri  = 

jv  €  R2 

R2  = 

( v  e  R2 
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/Z3  =  |v  6  R2  :  V2  >  1,  —1  +  “(^2  —  1)<VI<1  +  —(V2  —  1)  j  ? 

i?4  =  |v  G  R2  :  vi  <  — 1  +  —  («2  —  1),  i>2  >  1  +  ^(vi  +  1)| , 

-Rx,-R2,--R35  and  -i?4.  With  this  partition,  the  maximal  convergence  control  that  solves 
(55)  can  be  written  as, 


u=  < 


v, 


V2  -  c(v  1  -  1  )/b 


v\  -  c(v 2  -  l)/a 
1 


-1 

1 


if  v  G  i?0) 
,  if  u  G  i?i, 

if  v  G  i?2) 

,  if  v  G  i?3) 

if  v  G 


(66) 


and  for  v  G  -Ri,  -R2,  —R3  or  -R4,  the  optimal  control  u  is  symmetric.  Since  it,  does  not  solely 
depend  on  w;,  we  can  view  it  as  a  coupled  saturation  function  of  v.  If  m  >  2,  it  is  hard  to  put 
the  optimal  solution  into  an  explicit  formula.  However,  the  optimization  problem  (55)  can  be 
transformed  into  a  very  simple  LMI  problem: 


s.t. 


min  7 

u,7 

7  (u  —  v)T 
u-v  (BTPB)~1 


>0, 


!u|oo  ^  1. 


(67) 


This  optimization  problem  can  be  efficiently  solved  so  that  the  control  can  be  computed  and 
implemented  on  line.  It  can  be  shown  that  the  optimal  control  u  resulting  from  (67)  is  continuous 
in  v  and  hence  continuous  in  x. 

We  have  some  remarks  for  the  case  that  B  has  full  row  rank.  It  is  known  that  there  exists 
a  linear  dead-beat  control  for  this  case.  Let  B+  be  the  right  inverse  of  B,  then 


ArPB(BrPB)-1BTPA  =  ATPB(BTPB)~1BTPBB+A  =  ATPA. 


It  follows  that 

V(Ax  +  Bu)  =  (u  +  (BrPB)-1BrPAx)T  BTPB 

x  (u  +  (BTPB)-1BTPAxyj. 

It  is  easy  to  see  that  the  optimal  convergence  control  is  also  a  dead-beat  control  for  x  in  the 
region, 

{*  G  Rn  :  \(B'TPB)~1BTPAx\00  <  l}  . 
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Outside  of  this  region,  the  optimal  control  can  be  obtained  by  solving  a  simple  LMI  problem. 

Similar  to  the  continuous-time  case,  it  can  be  shown  that  the  overall  convergence  rate  in¬ 
creases  as  p  decreases.  And  if  £[P,p)  is  in  the  linear  region,  the  overall  convergence  rate  is  a 
constant  which  equals  to  that  of  a  linear  system. 

The  problem  of  disturbance  rejection  for  a  discrete-time  system  is  much  more  complicated 
than  its  continuous-time  counterpart.  This  is  because  the  expression  of  A V(x,u,w)  contains 
some  cross  terms  between  u  and  w  and  the  maximal  convergence  control  will  be  dependent  on 
w. 


4  Conclusions 

We  have  shown  in  this  paper  that,  for  a  continuous-time  system  subject  to  input  saturation  and 
persistent  disturbance,  the  maximal  convergence  rate  control  is  a  bang-bang  type  control  with  a 
simple  switching  strategy.  A  saturated  high  gain  feedback  is  developed  to  avoid  the  discontinuity 
of  the  bang-bang  control.  For  a  discrete-time  system,  the  maximal  convergence  control  is  a 
coupled  saturated  linear  feedback.  For  both  continuous-time  and  discrete-time  systems,  we 
also  provided  methods  for  determining  the  largest  ellipsoid  that  can  be  made  invariant  with  a 
bounded  control. 
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Abstract 

This  paper  studies  the  classical  problem  of  output  regulation  for  linear  systems  subject  to 
actuator  saturation.  The  asymptotically  regulatable  region,  the  set  of  all  initial  conditions  of 
the  plant  and  the  exosystem  for  which  output  regulation  is  possible,  is  characterized  in  terms  of 
the  null  controllable  region  of  the  anti-stable  subsystem  of  the  plant.  Output  regulation  laws  are 
constructed  from  a  given  stabilizing  state  feedback  law.  It  is  shown  that  a  stabilizing  feedback 
law  that  achieves  a  larger  domain  of  attraction  leads  to  a  feedback  law  that  achieves  output, 
regulation  on  a  larger  subset  of  the  asymptotically  regulatable  region.  A  feedback  law  that 
achieves  global  stabilization  on  the  asymptotically  null  controllable  region  leads  to  a  feedback 
law  that  achieves  output  regulation  on  the  entire  asymptotically  regulatable  region. 

Keywords:  actuator  saturation,  output  regulation,  regulatable  region. 
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1  Introduction 


There  has  been  considerable  research  on  the  problem  of  stabilization  and  output  regulation  of 
linear  systems  subject  to  actuator  saturation.  The  problem  of  stabilization  involves  the  issues  of 
the  characterization  of  null  controllable  region  (or,  asymptotically  null  controllable  region),  the 
set  of  all  initial  conditions  that  can  be  driven  to  the  origin  by  the  saturating  actuators  in  some 
finite  time  (or,  asymptotically),  and  the  construction  of  feedback  laws  that  achieve  stabilization 
on  the  entire  or  a  large  portion  of  the  asymptotically  null  controllable  region.  Recent  years  have 
witnessed  extensive  research  that  addresses  these  issues.  In  particular,  for  an  open  loop  system 
that  is  stabilizable  and  has  all  its  poles  in  the  closed  left-half  plane,  it  was  established  in  Macki 
and  Strauss  (1982)  and  Sontag  (1984)  that  the  asymptotically  null  controllable  region  is  the  entire 
state  space.  For  this  reason,  a  linear  system  that  is  stabilizable  in  the  usual  linear  sense  and  has 
all  its  poles  in  the  closed  left-half  plane  is  said  to  be  asymptotically  null  controllable  with  bounded 
controls,  or  ANCBC.  For  ANCBC  systems  subject  to  actuator  saturation,  various  feedback  laws 
that  achieve  global  or  semi-global  stabilization  on  the  null  controllable  region  have  been  constructed 
(see,  for  example,  Teel,  1992;  Sussmann,  Sontag  and  Yang,  1994;  Suarez,  Alvarez-Ramirez  and 
Solis-Daun,  1997;  Lin  and  Saberi,  1993;  and  Lin,  1998).  Here  by  semi-global  stabilization  on  the 
null  controllable  region  we  mean  the  construction  of  a  feedback  law  that  achieves  a  domain  of 
attraction  large  enough  to  include  any  a  priori  given  (arbitrarily  large)  bounded  set  in  the  null 
controllable  region. 

For  exponentially  unstable  open-loop  systems  subject  to  actuator  saturation,  it  was  shown  by 
Teel  (1996)  that  the  problem  of  stabilization  can  be  reduced  to  one  of  stabilizing  its  anti-stable 
subsystem,  whose  null  controllable  region  is  a  bounded  convex  open  set.  A  complete  character¬ 
ization  of  the  null  controllable  region  for  a  general  linear  system  was  developed  in  Hu  and  Lin 
(2001a),  where  simple  feedback  laws  were  also  constructed  that  achieve  semi-global  stabilization 
on  the  null  controllable  region  for  linear  systems  with  only  two  exponentially  unstable  poles.  More 
recently,  feedback  laws  have  been  constructed  that  achieve  semi-global  stabilization  on  the  null 
controllable  region  (Hu,  Lin  and  Shamash,  2001)  for  general  linear  systems  subject  to  actuator 
saturation. 

In  comparison  with  the  problem  of  stabilization,  the  problem  of  output  regulation  for  linear 
systems  subject  to  actuator  saturation,  however,  has  received  relatively  less  attention.  The  few 
works  that  have  motivated  our  current  research  are  De  Santis  (2000),  De  Santis  and  Isidori  (2001), 
Teel  (1992)  and  Lin,  Stoorvogel  and  Saberi  (1996).  In  Teel  (1992)  and  Lin  et  al  (1996),  the  problem 
of  output  regulation  was  studied  for  ANCBC  systems  subject  to  actuator  saturation.  In  Lin  et  al 
(1996),  necessary  and  sufficient  conditions  on  the  plant /exosystem  and  their  initial  conditions  were 
derived  under  which  output  regulation  can  be  achieved,  and  feedback  laws  that  achieve  semi-global 
output  regulation  were  constructed.  De  Santis  (2000)  and  De  Santis  and  Isidori  (2001)  made  an 
attempt  to  address  the  problem  of  output  regulation  for  exponentially  unstable  linear  systems 
subject  to  actuator  saturation.  The  attempt  was  to  enlarge  the  set  of  initial  conditions  of  the 
plant  and  the  exosystem  under  which  output  regulation  can  be  achieved.  In  particular,  for  plants 
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with  only  one  positive  pole  and  exosystems  that  contain  only  one  frequency  component,  feedback 
laws  were  constructed  that  achieve  output  regulation  on  what  we  will  characterize  in  this  paper  as 
the  regulatable  region. 

Apart  from  the  above  mentioned  literature,  there  also  exist  a  variety  of  results  on  the  problem 
of  output  regulation/output  tracking  with  saturating  actuators.  For  example,  Saberi,  Stoorvogel 
and  Sannuti  (1999)  considered  the  problem  for  ANCBC  systems  subject  to  actuator  and  rate 
saturation.  Blanchini  and  Miani  (2000)  studied  the  relation  between  stabilization  and  tracking  a 
reference  signal.  Tarbouriech,  Pittet  and  Burgat  (2000)  made  an  attempt  to  synthesize  nonlinear 
control  laws  for  local  output  regulation.  A  gain  scheduling  design  was  proposed  in  Lin,  Pachter 
and  Banda  (1998)  to  improve  the  transient  tracking  performance  for  second  order  systems  and  was 
generalized  by  Turner,  Postlethwaite  and  Walker  (2000).  Casavola  and  Mosca  (2001)  developed  a 
switching  logic  to  achieve  global  output  regulation  for  ANCBC  systems. 

The  objective  of  this  paper  is  to  systematically  study  the  problem  of  output  regulation  for 
general  linear  systems  subject  to  actuator  saturation.  Unlike  in  the  case  for  a  linear  system 
without  actuator  saturation,  where  output  regulation  can  be  achieved  for  all  initial  states,  here 
in  the  presence  of  saturation,  the  set  of  initial  states  for  which  output  regulation  is  possible  may 
not  be  the  whole  state  space.  For  instance,  suppose  that  we  have  an  exponentially  unstable  plant, 
then  it  is  known  that  the  set  of  initial  states  of  the  plant  that  can  be  kept  bounded  with  saturating 
actuators  is  not  the  whole  state  space.  The  set  of  initial  states  of  the  plant  where  output  regulation 
is  possible  is  even  more  restricted.  For  this  reason,  we  will  start  our  investigation  by  characterizing 
the  set  of  initial  states  of  the  plant  and  the  exosystem  where  output  regulation  is  possible  and  we 
will  call  this  set  the  regulatable  region.  It  turns  out  that  the  regulatable  region  can  be  characterized 
in  terms  of  the  null  controllable  region  of  the  anti-stable  subsystem  of  the  plant. 

We  then  proceed  to  construct  output  regulation  laws  from  a  given  stabilizing  state  feedback 
law.  We  show  that  a  stabilizing  feedback  law  that  achieves  a  larger  domain  of  attraction  leads 
to  a  feedback  law  that  achieves  output  regulation  on  a  larger  subset  of  the  regulatable  region 
and,  a  stabilizing  feedback  law  on  the  entire  null  controllable  region  leads  to  a  feedback  law  that 
achieves  output  regulation  on  the  entire  regulatable  region.  Our  feedback  law  employs  a  switching 
scheme  which  generalizes  the  safe  switching  idea  of  Wredenhagen  and  Belanger  (1994),  where  the 
switching  was  based  on  a  group  of  nested  ellipsoids.  In  this  paper,  the  switching  is  based  on  a 
group  of  nested  invariant  sets,  which  may  not  even  be  convex. 

The  remainder  of  this  paper  is  organized  as  follows.  In  Section  2,  we  state  the  problem  of  output 
regulation  for  linear  systems  with  saturating  actuators.  Section  3  characterizes  the  regulatable 
region.  Sections  4  and  5  respectively  construct  state  feedback  and  error  feedback  laws  that  achieve 
output  regulation  on  the  regulatable  region.  In  Section  6,  we  illustrate  our  results  on  an  aircraft 
model.  Finally,  Section  7  gives  a  brief  concluding  remark  to  our  current  work. 

Throughout  the  paper,  we  will  use  standard  notation.  For  a  vector  u  €  Rm,  we  use  |u|oo  and 
|ti|2  to  denote  the  vector  oo-norm  and  the  2-norm.  For  a  measurable  function  u  :  [0,  oo)  — >•  Rm,  we 
define  ]|u]|oo  =  suptG[0)OO]  |u(t)|oo-  We  use  sat(-)  to  denote  the  standard  saturation  function,  i.e., 
the  ith  component  of  sat(u)  is  sgn(tij)  min{l,  |ui|}. 
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2  Preliminaries  and  Problem  Statement 


In  this  section,  we  first  recall  from  Francis  (1975)  and  Isidori  and  Byrnes  (1990)  the  classical 
formulation  and  results  on  the  problem  of  output  regulation  for  linear  systems.  This  brief  review 
will  motivate  our  formulation  as  well  as  the  solution  to  the  problem  of  output  regulation  for  linear 
systems  subject  to  actuator  saturation. 

Consider  a  linear  system 

x  =  Ax  +  Bu  +  Pw, 

w  =  Sw ,  (1) 

e  =  Cx  +  Qw. 

The  first  equation  of  this  system  describes  a  plant,  with  state  x  £  Rn  and  input  u  £  Rm,  subject  to 
the  effect  of  a  disturbance  represented  by  Pvj.  The  third  equation  defines  the  error  e  £  R9  between 
the  actual  plant  output  Cx  and  a  reference  signal  —Qw  that  the  plant  output  is  required  to  track. 
The  second  equation  describes  an  autonomous  system,  often  called  the  exosystem,  with  state 
w  £  Rr.  The  exosystem  models  the  class  of  disturbances  and  references  taken  into  consideration. 

The  control  action  to  the  plant,  u,  can  be  provided  either  by  state  feedback  or  by  error  feedback. 
The  objective  is  to  achieve  internal  stability  and  output  regulation.  Internal  stability  means  that  if 
we  disconnect  the  exosystem  and  set  w  equal  to  zero  then  the  closed-loop  system  is  asymptotically 
stable.  Output  regulation  means  that,  for  any  initial  conditions  of  the  plant  and  the  exosystem, 
the  state  of  the  plant  is  bounded  and  e(t)  — >  0  as  t  ->  oo. 

The  solution  to  the  output  regulation  problem  was  first  obtained  by  Francis  (1975).  It  is  now 
well  known  that  under  some  mild  necessary  assumptions,  the  output  regulation  problem  is  solvable 
if  and  only  if  there  exist  matrices  II  and  F  that  solve  the  linear  matrix  equations 

us  =  ah+bt  +  p, 

cn+c?  =  o.  [) 

For  more  detail  about  the  assumptions  and  the  solution,  see  Francis  (1975)  and  Isidori  and  Byrnes 
(1990). 

In  this  paper,  we  study  the  problem  of  output  regulation  for  the  linear  system  (1)  subject 
to  actuator  saturation,  where  the  control  signal  u  is  the  output  of  saturating  actuators  and  can 
be  assumed  to  be  measurable  and  satisfy  the  bound  ||u||oo  <  1.  A  control  u  that  satisfies  these 
assumptions  will  be  referred  to  as  an  admissible  control. 

Following  Francis  (1975),  Isidori  and  Byrnes  (1990)  and  Lin  et  al  (1996),  we  make  the  following 
necessary  assumptions  on  the  plant  and  the  exosystem: 

Al.  The  matrix  equations  (2)  have  solution  (II,  F); 

A2.  The  matrix  S  has  all  its  eigenvalues  on  the  imaginary  axis  and  is  neutrally  stable; 

A3.  The  pair  (A,  B )  is  stabilizable; 

A4.  The  initial  state  wq  of  the  exosystem  is  in  the  following  set 

Wo  =  {wo  G  Rr  :  |rw(t)|oo  =  |restw0|oo  <  P,  Vt  >  0}  ,  (3) 

for  some  p  £  [0, 1)  and  Wo  is  compact.  For  later  use,  we  denote  6  —  1  —  p. 
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We  note  that  the  compactness  of  Wo  can  be  guaranteed  by  the  observability  of  (r,  S').  Indeed, 
if  (r,  5)  is  not  observable,  then  the  exosystem  can  be  reduced  to  make  it  so.  As  will  be  seen 
shortly,  the  exosystem  affects  the  output  regulation  property  through  the  signal  Tw(t). 

3  The  Regulatable  Region 

To  begin  with,  we  define  a  new  state  z  =  x  —  Uw  and  rewrite  the  system  equations  as 

z  —  Az  +  Bu  —  BTw , 

w  =  Sw>  (4) 

e  =  Cz. 

This  particular  state  transformation  has  been  traditionally  used  in  the  output  regulation  literature 
to  transform  the  output  regulation  problem  into  a  stabilization  problem.  The  remaining  part  of 
the  paper  will  be  focused  on  system  (4).  All  the  results  can  be  easily  restated  in  terms  of  the 
original  state  of  the  plant  x  by  replacing  z  with  x  —  Uw.  Here  we  note  that,  when  w  ~  0,  the 
internal  stability  in  terms  of  z  is  the  same  as  that  in  terms  of  x.  As  to  output  regulation,  it  is  clear 
that  e(t)  goes  to  zero  asymptotically  if  z(t)  does.  To  combine  the  objectives  of  achieving  internal 
stability  and  achieving  output  regulation,  we  will  define  the  notion  of  regulatable  region  in  terms 
of  driving  z(t)  to  zero  instead  of  driving  e(t)  to  zero.  As  will  be  explained  in  detail  in  Remark  1, 
this  will  result  in  essentially  the  same  description  of  the  regulatable  region  and  will  avoid  some 
tedious  technical  discussions. 

Definition  1 

1 )  Given  aT  >  0,  a  pair  (zo,  wo)  €  Rn  x  Rr  is  regulatable  in  time  T  if  there  exists  an  admissible 
control  u(-),  such  that  the  response  of  (4)  satisfies  z(t)  =  0  for  all  t  >  T ; 

2)  A  pair  (zq^wq)  is  regulatable  if  there  exist  a  finite  T  >  0  and  an  admissible  control  u(-)  such 
that  z(t)  =  0  for  all  t  >  T; 

3)  The  set  of  all  (zq,wq)  regulatable  in  time  T  is  denoted  as  7 Zg(T)  and  the  set  of  all  regulatable 
(zq,  Wo)  is  referred  to  as  the  regulatable  region  and  is  denoted  as  lZg; 

4)  The  set  of  all  (zq^wq)  for  which  there  exists  an  admissible  control  u(-)  such  that  the  response 

of  (4)  satisfies  z(t)  =  0  is  referred  to  as  the  asymptotically  regulatable  region  and  is 

denoted  as  7 Zg. 

It  is  clear  that  Tlg{Ti)  C  Tlg(T 2)  if  T2  >  T\.  Because  of  Assumption  A4,  the  requirement  in 
Defintion  1  that  z(t)  =  0  for  all  £  >  T  can  be  replaced  with  z(T )  =  0. 

We  will  describe  'Rg{T))  TZg  and  7 Zg  in  terms  of  the  null  controllable  region  of  the  plant 
v  =  Av  +  Bu}  ||u||oo  <  1,  which  is  defined  as  follows. 

Definition  2  The  null  controllable  region  in  time  T,  denoted  as  C(T),  is  the  set  of  vo  €  Rn  that 
can  be  driven  to  the  origin  in  time  T  by  admissible  controls;  The  null  controllable  region }  denoted 
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as  C,  is  the  set  of  v0  G  Rn  that  can  be  driven  to  the  origin  in  a  finite  time  by  admissible  controls; 
The  asymptotically  null  controllable  region,  denoted  as  Ca ,  is  the  set  of  all  vq  that  can  be  driven  to 
the  origin  asymptotically  by  admissible  controls. 


Clearly,  C  =  Ure[0,oo)  C(T)  and 


C(T)  = 


(5) 


It  is  also  clear  that  the  null  controllable  region  and  the  asymptotically  null  controllable  region  are 
identical  if  the  pair  (A,  B)  is  controllable.  Some  simple  methods  to  describe  C  and  Ca  were  recently 
developed  in  Hu  and  Lin  (2001a). 

To  simplify  the  characterization  of  TZg  and  %ag,  let  us  assume,  without  loss  of  generality,  that 


,  z\  G  Rni ,  z2  €  Rn2  and 


Ai  0 

0  a2 


B 


Bi 

B2 


(6) 


where  A\  G  R"lXni  is  semi-stable  (i.e.,  all  its  eigenvalues  are  in  the  closed  left-half  plane)  and 
A2  G  R”2Xn2  is  anti-stable  (i.e.,  all  its  eigenvalues  are  in  the  open  right-half  plane).  The  system 
including  the  anti-stable  subplant  and  the  exosystem 


z2  —  A2z2  +  B2u  —  B2Tw, 
w  =  Sw, 


(7) 


is  of  crucial  importance.  Denote  its  regulatable  regions  as  TZg2(T),  TZg^  and  and  the  null 
controllable  regions  for  the  system  v2  =  A2v2  +  B2u  as  C2{T)  and  C2.  Then,  the  asymptotically 
null  controllable  region  for  the  system  v  =  Av  +  Bu  is  given  by  Ca  =  Rni  x  C2  (Hajek,  1991), 
where  C2  is  a  bounded  convex  open  set.  Denote  the  closure  of  C2  as  C2,  then 

C2  =  |v2  €  R"2  :  v2  =  e~A2TB2u(T)dr,  ||«||oo  <  l|  - 
Also,  if  D  is  a  closed  subset  of  C2,  then  there  is  a  finite  T  >  0  such  that  D  C  C2(T). 


Theorem  1  Let  V2  G  R"2Xr  be  the  unique  solution  to  the  matrix  equation 


-A2V2  +  V2S  =  -B2T 
and  let  V(T)  =  V2-  e~MT  V2  eST .  Then 


0 

TZ32(T)  =  {{z2,w)  €  R712  x  Wo  :  Z2  -  V(T)w  G  C2(T)} ; 

(8) 

ii ) 

TZ 32  =  {{z2,  w )  G  R”2  x  Wo  :  z2  —  V2w  G  C2 } ; 

(9) 

Hi) 

nag  =  Rni  x  n92. 

(10) 
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Proof,  i)  Given  (220,  wo)  G  Rn2  x  Wo  and  an  admissible  control  u,  the  solution  of  (7)  at  t  =  T  is, 
z2 (T)  =  eAiT  ^20  +  J  e~A2T  B2u(r)dT  -  j  e~A2TB2TeSTwodT j  .  (11) 

Since  —A2V2  +  V2S  =  —B2T,  we  have 

=  e-A2T(-A2V2)eST  +  e~A2TV2SeST  =  e~A2T{-A2V2  +  V2S)eSr  =  -e~A2T  B2VeSr , 
ar 

noting  that  A2  and  e~A2T  commute,  and  S  and  eSr  commute.  Hence, 

-  (\-A2Wdr=  [T  de~A2TV2eST  =  e~A2TV2eST  -V2  =  -V(T). 

Jo  Jo 


Therefore, 


P -MT 


z2{T)  =  z2o  ~  V(T)w 0  +  f  e  A2T B2u(r)dT. 

Jo 


(12) 

(13) 


To  prove  (8),  it  suffices  to  show  that  Z20  —  V(T)wq  G  C2(T)  (z2o,  ^0)  G  7Z92(T). 

If  Z20  —  V(T)w 0  G  C2(T),  then  by  (5),  there  exists  an  admissible  control  u\  such  that 

220  -  V(T)w0  =  [T e~A2TB2UX{r)dT. 

Jo 

Let  u(t)  =  —u\  ( t )  for  t  G  [0,  T]  and  u(t)  —  Tw(t)  for  t>  T,  then  u  is  admissible  by  Assumption  A4 
and  it  follows  from  (13)  that  z2(T)  =  0  and  z2  (t)  =  0  for  alii  >  T.  Therefore,  (z2o,  wq)  G  7Z92(T). 
On  the  other  hand,  if  (z2o,wo)  G  7Z92(T),  then  there  exists  an  admissible  u  such  that  z2(T)  =  0. 
Also  by  (13),  we  have 

Z20  ~  V(T)w 0  +  f  e~A2TB2u{T)dT  =  0, 

Jo 

which  implies  that  z2o  —  V(T) wq  G  C2(T). 

ii)  Since  A2  is  anti-stable  and  S  is  stable,  we  have  that  limr-j-co  V (T)  =  V2.  It  follows  from 
(12)  that 

p  00 

V2=  e~A2TB2reSTdT.  (14) 

Jo 

First  we  show  that  z2o  —  V2wq  G  C2  ==>  (z2o,wo)  G  7 Z92-  Since  C2  is  open,  there  exists 
an  e  >  0  such  that  {220  —  V2wq  +  z2  ■  \z2\oo  <  e}  C  C2-  Also,  there  exists  a  T\  >  0  such  that 
{z2o  -  V2wo  +  z2  :  |^2  |oo  <  e}  C  C2(T1').  Since  limr->oo  V (T)  =  V2,  there  is  a  T2  >  T\  such  that 
z2 0  —  V(T2)w0  G  C2(Ti)  C  C2(T2).  It  follows  from  i)  that  (z2o,  wq)  G  7l92(T2)  C  7 Z92. 

Next  we  show  that  (z2o,w0)  G  7 Z92  =>■  z20  -  V2w0  G  C2.  If  (220,  wo)  G  7 Z92,  then  (^20,^0)  G 
TZ92(Ti)  for  some  T\  >  0.  It  follows  from  the  definition  of  7 Zg(T)  that  there  is  an  admissible  control 
u\  such  that 

Z20  ~  [  e~A2TB2TeSTwodT  +  [  e~A2T B2ui(T)dr  —  0.  (15) 

Jo  Jo 

Denote  Z2  =  ^Se~A2Tlv2  ■  v2  G  C2\.  For  each  z2  €  Z2,  there  is  an  admissible  control  u2  such 


that 


poo  poo 

z2  =  Se~A2Tl  /  e~A2TB2U2{r)dT  =  /  e~A2T  B2Su2(t  —  Ti)dr. 
Jo 
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It  follows  from  (14)  and  (15)  that 


roo  roo 

Z2Q-V2WQ  +  Z2  =  Z20-  e~A2TB2TeSrwodr+  e~A2TB2Su2(r -Ti)dr 

Jo  Jtx 


Ti 

00 


=  z2o  —  j  e  A2TB2TeSTwodr  +  j  e  A2T B2  (6u2(t  —  Ti)  —  TeSr woj  dr 
=  -  e~A2TB2ul{T)dT  +  J™  e~MTB2  (Su2{t  -  2\)  -  FeSTw0)  dr 


G  C2. 


The  last  step  follows  from  the  fact  that  |re5Tu>o|oo  <  p  —  1  —  5  for  all  r  >  0  and  that  the  input 
u(t)  =  ui(t)  for  t  £  [0,  Ti],u(i)  =  du2(t  -  T\)  -  Testwo  for  t  >  T\  is  admissible.  This  implies  that 

{z20  ~  V2wq  +  z2  ■  z2  G  Zi]  C  C2. 

Since  e~A2Tl  is  nonsingulax,  the  set  Z2  contains  the  origin  in  its  interior.  It  follows  that 

Z20  —  V2wo  £  C2- 

iii)  We  first  show  that  7£“2  =  7 Zg2.  It  is  easy  to  see  that  JZg2  C  7£“2.  To  show  1Zg2  C  77S2, 
suppose  we  are  given  z2o  G  77“  2-  Then  there  exits  a  finite  time  T  and  an  admissible  control  such 
that  z2 (T)  £  5C2  since  SC2  is  an  open  set  containing  the  origin.  For  t  >  T,  let  u  =  Tw  +  u$  with 
||«<f||oo  <  Since  wq  £  Wo,  we  have  HrtnHoo  <  p  and  hence,  ||u||oo  <  1  and 

z2  =  A2Z2  +  B2u  -  B2Yw  =  A2z2  +  B2  us . 


Since  z2(T)  £  6C2,  we  have  a  control  us  and  a  finite  Ti  >  T  such  that  z2 (T\ )  =  0.  So  we  have 
z2o  G  77fl2,  and  hence  77“2  C  fcg2.  Therefore,  7 Zg2  =  1Z92. 

Now  we  show  that  7 Zag  C  Rni  x  7 Zg2.  Suppose  {zq,wq)  =  (^10,220,^0)  G  7Zg,  then  there  exists 
an  admissible  control  such  that  limt_»oo  z2{t)  —  0.  This  implies  that  (^20,^0)  C  Hg2  =  77<,2. 

We  next  show  that  Rni  x  7 Z92  C  lZg.  Suppose  (^io,  ^20,^0)  G  Rni  x  7 Zg2,  then  there  exist  a 

"  zi(T) 


T  >  0  and  an  admissible  control  such  that  z2{T)  =  0.  Since 


is  inside  the  asymptotically 


null  controllable  region  for  the  system  z  =  Az  +  Bus  under  the  constraint  ||u;||oo  <  <5  (Hajek, 
1991),  there  exists  a  u  —  Fw  +  us  for  t  >  T  such  that  limt-**,  z(t)  =  0.  Hence  (zq,wq)  £  77“ .  This 
establishes  that  Rni  x  7Zg2  C  77“  and  hence  Rni  x  7 Z92  =  77“.  □ 


Remark  1  Here  we  justify  the  requirement  of  driving  z(t),  instead  of  e(t),  to  zero  in  Defintion  1. 
From  the  above  theorem,  we  see  that  (zq,wo)  is  regulatable  if  and  only  if  z2q  —  V2wo  G  C2.  This  is 
essentially  the  necessary  condition  to  keep  z2(t)  bounded.  We  explain  this  as  follows:  Suppose  that 
z2o  —  V2wq  $  C2,  then  there  exists  an  e  >  0  such  that  \z2q  —  V2wq  —  z2\2>  s  V  z2  G  C2.  Since 

fT 

lim  /  e~A2T B2FeST wodr  =  V2wo, 

T^coJo 


and 


-  [  e  A2T B2u{T)dr  £  C2, 
Jo 


VT>  0,  Hoo<l, 
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there  exists  a  To  >  0  such  that 


220-  [T  e~A2TB2TeSTWQdr  +  [  e  A2TB2u(t)cIt 
Jo  Jo 


2’ 


V  T  >  Tq. 


Since  the  smallest  singular  value  of  eAiT  increases  exponentially  with  T,  it  follows  from  (11)  that 
z2(T)  will  grow  unbounded  whatever  admissible  control  is  applied.  Hence  even  if  the  requirement 
limf  )0O  z(t)  =  0  is  replaced  with  limt_»oo  eft)  =  0,  we  still  require  z20  -  V2w0  €  C2  to  achieve 
output  regulation.  The  gap  only  arises  from  the  boundary  of  C2.  It  is  unclear  whether  it  is  possible 
to  achieve  lim^co  e(f)  =  0  with  z(t)  bounded  for  z2o  —  V2wo  £  dC2.  Since  this  problem  involves 
too  much  technical  detail  and  is  of  little  practical  importance  (we  will  not  take  the  risk  to  allow 
220  —  V2w0  £  dC2,  otherwise  a  small  perturbation  can  cause  the  state  to  grow  unbounded),  we  will 
not  address  this  subtle  technical  point  here. 


4  State  Feedback  Controller 

In  view  of  what  has  been  discussed  in  the  previous  section,  the  set  of  initial  conditions  for  which 
output  regulation  can  be  achieved  with  any  feedback  law  must  be  a  subset  of  Kg.  In  this  section, 
we  would  like  to  search  for  a  state  feedback  law  u  =  g{z,w)  such  that  this  subset  is  as  close  as 
possible  to  Tig. 

With  a  state  feedback  u  =  g(z,w),\g(z,w)\oo  <  1  for  all  (z,w)  £  Rn  x  Wo,  we  have  the 
closed-loop  system 

z  =  Az  +  B  g(z,w)  -  BFw,  (16) 

w  —  Sw. 

Suppose  that  the  system  z  =  Az  +  Bg(z,  0)  is  asymptotically  stable  at  z  =  0.  Denote  the  time 
response  z(t )  of  (16)  to  the  initial  state  (zq,wq)  as  z(t,zo,wo)  and  define 

Szw  :=  | (z0,  wo)  £  Rn  x  Wo  :  Hmz(Mo,»o)  =  oj  . 

We  see  that  Szw  is  the  set  of  initial  states  for  which  output  regulation  is  achieved  by  u  —  g(z,  w). 
Also,  the  intersection  of  Szw  with  the  z  space  serves  as  the  domain  of  attraction  for  the  system 
z  =  Az  +  Bg(z,0),  where  internal  stability  is  achieved. 

It  is  clear  that  Szw  C  Hag.  Our  objective  is  to  search  for  a  function  gf,  ■)  such  that  z  = 
Az+ Bg{z,  0)  is  asymptotically  stable  and  Szw  is  as  large  as  possible,  or  as  close  as  possible  to  Hag. 

We  assume  that  a  stabilizing  state  feedback  law  u  =  f(v),  |/(v)|oo  ^  1  for  aU  v  £  Rn>  has  been 
designed  and  the  equilibrium  v  —  0  of  the  closed-loop  system 

v  =  Av  +  Bf(v)  (17) 

has  a  domain  of  attraction  S  C  Ca.  We  will  construct  an  output  regulation  law  from  this  stabilizing 
feedback  law. 
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Furthermore,  we  malce  the  assumption,  that  will  be  removed  later,  that  there  exists  a  matrix 
V  G  Rnxr  such  that 

-AV  +  VS  =  -BT.  (18) 

This  will  be  the  case  if  A  and  S  have  no  common  eigenvalues.  With  the  decomposition  in  (6),  if 


Vi 

V2 


,  then  V2  satisfies  —A2V2  4-  V2S  =  —B2Y. 


we  partition  V  accordingly  as 
Denote 

Dzw  :=  {(z,w)  G  R"  x  >Vo  :  z  —  Vw  €  S}  , 


(19) 


From  Theorem  1  and  Ca  =  Rm  x  C2,  we  see  that 

a)  The  set  DZVJ  increases  as  S  increases,  and  if  <S  =  Ca,  then  Dzw  =  7 Z“; 

b)  In  the  absence  of  w,  xq  G  S  =>■  (zq,0)  G  Dzw. 


We  will  construct  an  output  regulation  law  from  the  stabilizing  feedback  law  u  =  f(v)  in  such 
a  way  that  Dzw  C  Szw.  It  is  then  clear  that  if  /  is  chosen  such  that  S  =  Ca,  then  Dzw  =  7 Z*  and 
Szw  =  1 Zg.  Our  controller  construction  is  based  on  a  series  of  technical  lemmas.  In  the  sequel,  a 
set  D  is  said  to  be  invariant  for  a  system  if  every  trajectory  of  the  system  starting  from  D  will 
stay  in  D. 


Lemma  1  Let  u  =  f(z  —  Vw ).  Consider  the  closed-loop  system 

z  =  Az  +  Bf(z  —  Vw )  —  BTw, 
w  =  Sw. 

For  this  system,  Dzw  is  an  invariant  set  and  for  all  (zq.  wq)  G  Dzw>  limt-Kx^OO  -  Vw(t))  =  0. 

Proof.  Because  of  (18),  we  can  replace  —  BY  in  (20)  with  —AV  +  VS,  i.e., 

z  =  Az  +  Bf(z —  Vw)  —  AV  w -+VSw 
=  A(z  —  Vw)  +  Bf(z  —  Vw)  +  Vw. 

Define  the  new  state  v  ~  z  —  Vw,  we  have 

v  =  Av  +  Bf(v), 

which  has  a  domain  of  attraction  S.  This  also  implies  that  S  is  an  invariant  set  for  the  v-system. 

If  (zo,w0)  €  Dzw,  then  v0  =  z0  -  Vw0  G  S.  It  follows  that  v(t)  =  z(t)  -  Vw(t)  G  S  for  all 
t  >  0,  which  means  that  Dzw  is  invariant,  and  lim^oo (z{t)  ~  Vw(t))  =  limi^oou(i)  =  0.  □ 

\ 

Lemma  2  Suppose  that  DcR"  is  an  invariant  set  in  the  domain  of  attraction  for  the  system 

v  =  Av  +  B<f>{v),  (21) 

then  for  any  a  >  0,  aD  is  an  invariant  set  in  the  domain  of  attraction  for  the  system 

v  —  Av  +  aB(j>  ^  .  (22) 
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Proof.  Write  (22)  as 


-  =  a-  +  B4> 

a  a 


and  replace  —  with  v,  then  we  get  (21).  If  vq  G  aD,  i.e.,  ^  Gfl,  then  ~~  G  D  for  all  t  >  0  and 

limt->oov{t)  =  0.  a 

Lemma  1  says  that,  in  the  presence  of  w,  the  feedback  u  =  f(z  —  Vw)  will  cause  z(t)  —  Vw(t) 
to  approach  zero  and  z(t)  to  approach  Vw(t),  which  is  bounded.  Our  next  step  is  to  construct  a 
finite  sequence  of  controllers  u  =  fk(z,  w,  a),  k  —  0, 1, 2,  •  •  • ,  N ,  all  parameterized  in  a  G  (0, 1).  By 
judiciously  switching  between  these  controllers,  we  can  cause  z(t)  to  approach  akVw(t)  for  any  k. 
By  choosing  N  large  enough,  z{t)  will  become  arbitrarily  small  in  a  finite  time.  Once  z(t)  becomes 
small  enough,  we  will  use  the  controller  u  =  Fto  +  S  sat(^)  (F  to  be  specified  below)  to  make  z(t) 
converge  to  the  origin. 

Let  F  €  Rmxn  be  such  that 

v  =  Av  +  B  sat  (Fv)  (23) 

is  asymptotically  stable.  Let  X  >  0  be  such  that  (.4  +  BF)'r X  +  X(A  +  BF)  <  0  and 

f:={t)£Rn:  vTXv  <  1}  C  {v  G  Rn  :  IPuloo  <  1}. 

Then  £  is  an  invariant  set  in  the  domain  of  attraction  for  the  closed-loop  system  (23). 

For  any  a  €  (0, 1),  there  exists  a  positive  integer  N  such  that 

aN\xWw\2  <  6 ,  V«eW0,  (24) 

i.e.,  v  =  aNVw  e  <5£,  for  all  to  6  Wo-  Define  a  sequence  of  subsets  in  Rn  x  Wo  as, 

Dkzw  =  {(z,w)  €Rn  xW0:z-akVw  €ak£},  k  =  0, 1,  •  •  •  ,N, 

D™  =  {(*,«)  €RnxW0  :ze6£}, 


and,  on  each  of  these  sets,  define  a  state  feedback  law  as  follows, 
fk(z,w,a)  =  (1  -  ak)Tw  +  ak  sat  ( ^- — ? 


In+i(z, w )  =  Vw  +  S sat  ■ 


k  =  0, 1,  -  -  - ,  N, 


It  can  be  verified  that,  for  any  k  =  0  to  N  +  1,  \fk(z,w,a)\oo  <  1  for  all  (z,w)  €  Rn  x  Wo- 

Lemma  3  Let  u  =  fk(z,w,a).  Consider  the  closed-loop  system 

z  =  Az  +  Bfk{z,w,a)  -  BTw, 

w  =  Sw.  ^  ' 

For  this  system,  Dkw  is  an  invariant  set.  Moreover,  if  k  =  0, 1  ,•••  ,N,  then  for  all  (zo,u>o)  G  Dkw, 
limt^oo(2(t)  -  akVw(t ))  =0;  if  k  =  N  +  1,  then,  for  all  {z0,w o)  G  D^1,  hm^ooZ^)  =  0. 
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Proof.  With  u  =  fk{z,  w,  a),  k  =  0, 1,  •  •  • ,  N,  we  have 


i  =  Az  +  (1  —  ak)BTw  +  akB  sat 


kD...lF<.*-akVwy 


—  BTw 


a 


(26) 


=  Az  +  akBsat  -  akBTw. 

Let  Vk  =  z  —  akVw,  then  by  (18), 


■bk  =  Avk  +  a*i?sat  (  • 


(27) 


It  follows  from  Lemma  2  that  ak£  is  an  invariant  set  in  the  domain  of  attraction  for  the  u^-system. 
Hence  Dkw  is  invariant  for  the  system  (25)  and  if  (zq,wo)  6  Dkw,  i.e.,  Vko  =  zq  —  akVwo  €  ak£, 
then  limt_+00(z(t)  -  akVw(t))  =  lim£_,oo  Vk{t)  =  0. 

With  u  =  fx+i(z,  w),  we  have  i  =  Az  +  8Bs&t  and  the  same  argument  applies.  □ 

For  k  =  0, 1,  •  •  • ,  N  +  1,  denote  Qk  =  U f=k-^iw  We  clearly  have  ft0  D  ft1  ■  •  •  D  QN  D  £lN+1. 
Based  on  the  technical  lemmas  established  above,  we  construct  our  state  feedback  law  as  follows, 


u  =  g{z,  w,  a,  N ) 


'  fN+i(z,w),  if  ( z,w )  enN+1, 

<  fk(z,w,a),  if  (z,w)  G  ftfc  \ftfc+1,  k  =  0, 1,  —  ,  iV, 
k  f(z-Vw),  if  (z,  w)  6  Rnx  Wo  \  ft0. 


Since  flk,  k  =  0, 1,  •  ■  • ,  N  + 1  are  nested,  the  controller  is  well  defined  on  Rn  x  Wo-  What  remains 
to  be  shown  is  that  this  controller  will  accomplish  our  objective  if  the  parameter  a  is  properly 
chosen.  Let 

|X2F™|2 

ao  =  max  — t - 1 — . 

weWo  \XWw\2  +  l 

It  is  obvious  that  ao  E  (0, 1). 


Theorem  2  Choose  any  a  E  (ao,l)  and  let  N  be  chosen  such  that  (24)  is  satisfied.  Then  for  all 
(zq,wq)  E  Dzw,  the  time  response  of  the  closed-loop  system 

z  =  Az  +  B  g(z,w,a,N)  -  BFw,  (28) 

w  —  Sw 


satisfies  lim^oo  z(t)  =  0,  i.e.,  Dzw  C  Szw. 

Here  we  note  that  the  control  u  =  g(z ,  w ,  a,  N)  is  executed  by  choosing  one  from  fk{z ,  w,  a),  k  = 
0, 1,  •  •  -  ,N  +  1,  and  f(z  —  Vw ).  Since  the  control  is  discontinuous  in  £  and  w ,  it  is  necessary  to 
ensure  that  the  trajectories  are  well  behaved  and  no  chattering  will  ocur.  We  will  generalize  the  safe 
switching  idea  of  Wredenhagen  and  Belanger  (1994)  to  guarantee  this.  Actually,  the  crucial  point 
behind  the  safe  switching  in  Wredenhagen  and  Belanger  (1994)  is  that  each  of  the  nested  ellipsoids, 
on  which  the  switching  is  based,  is  invariant.  Here  under  the  control  of  u  =  g(z ,  w,  a,  N ),  we  also 


11 


have  a  group  of  nested  invariant  sets,  f2fc,  k  =  0, 1,  ■  •  • ,  N  +  1.  But  these  sets  are  not  ellipsoids, 
nor  necessarily  convex. 

Proof  of  Theorem  2.  We  first  claim  that  for  each  k  =  0, 1,  •  •  • ,  N  +  1,  the  set  is  an  invariant 
set  under  the  control  of  it  =  g(z,  w,  a,  N ),  and  every  trajectory  starting  from  ft*  will  enter  a  subset 
ftfc+1  at  a  finite  time. 

We  prove  the  claim  by  induction.  By  Lemma  3,  we  know  that  QN+l  =  D^1  is  an  invariant 
set.  Hence,  the  claim  is  true  for  k  =  N  4-  1.  We  assume  that  it  is  true  for  k  +  1  and  need  to  show 
that  it  is  also  true  for  k. 

Here  we  are  given  (z0,  w0)  G  ft*.  If  (z0,  w0)  G  ft*+1,  then  by  assumption,  (z(t),w{t))  G  ft*+1  C 
ft*  for  all  t  >  0.  If  {z0,w 0)  G  ft*  \  ft*+1,  then  (zq,w o)  G  Dkw  and  u  =  fk{z,  w,  a).  By  Lemma  3, 
(z(t),w(t))  G  Dkw  for  all  t  >  0  and  limt_»oo(z(i)  -  akVw(t))  =  0.  Since  a  G  (o-o,  1),  we  have 
(1  —  a)|X2  Vw\2  <  a  for  all  w  G  Wo-  Therefore,  for  k  <  N, 

p d{z-ak+1Vw)\2  <  \X2{z-akVw)\2  +  ak{l-a)\X2Vw\2 

<  \X*{z  —  akVw)\2  +  ak+1.  (29) 

Since  the  first  term  goes  to  zero  asymptotically,  there  exists  a  finite  time  t\  >  0  such  that 

\X*(z{t\)  -  afc+1TAu;(ii))|2  <  o;fc+1. 

This  implies  that  z(*i)  —  ak+1Vw(ti)  G  ak+1£,  i.e.,  (^(ti),iy(ti))  G  Dk+k.  If  k  =  N,  then,  by  (24), 

\xh\2  <  \Xl*{z-aNVw)\2  +  aN\X2Vw\2 
<  \X*(z  -  aNVw)\2  + 5. 

Also,  the  first  term  goes  to  zero  asymptotically,  so  there  exists  a  finite  time  ti  such  that  \X%z(ti)\2 
Sj  i.e.,  (z(ti),  iu(t^))  G  ^  ■  The  state  (z(t),m(t))  might  have  entered  some  other  set  D 1  ^ 
1,  at  an  earlier  time  than  ti.  But  in  any  case,  it  will  enter  Qk+1  at  a  finite  time  under  the  control 
of  u  =  fk(z,w ,  a).  Thus  we  have  completed  the  proof  of  the  claim. 

Let  us  now  consider  (z0,w0)  G  Dzw.  If  (z0,w0)  G  0°,  then  by  the  foregoing  claim,  we  have 
(z(t),w(t))  G  ft0  for  all  t  >  0.  If  {z0,w0)  G  Dzw  \  fi°,  then  u  =  f(z  -  Vw)  and  by  Lemma  1, 
(z(t),w(t))  G  Dzw  and  limt^O0(z(i)  -  Vw(t))  =  0.  Hence  there  is  a  finite  time  such  that  z(t)  - 
Vw(t)  G  £,  i.e.,  (z(t),w(t))  G  Dzw.  Similarly,  (z(t),w(t))  might  have  entered  some  other  sets 
Dlz w,  l  >  0,  but  in  any  case,  it  will  enter  the  set  ft0  at  a  finite  time. 

We  know  that  the  sets  Clk,  k  —  0, 1, 2,  •  •  • ,  N  + 1  are  nested  and  each  of  them  is  an  invariant  set 
under  the  control  u  =  g(z,w,a,N).  Moreover,  every  trajectory  starting  from  Dzw  will  enter  fit0 
and  subsequently  into  smaller  and  smaller  Clk  and  finally  enter  ClN+1  at  a  finite  time.  After  that 
we  have  u  =  /^+1(z,iy)  and  by  Lemma  3,  (z(t),w(t))  will  remain  there  and  lim^oo  z(t)  =  0. 

Here  we  have  a  final  remark  on  the  behavior  of  the  trajectories  of  (28).  Since  ftk.  k  — 
0,1,-*  •  ,1V  +  1  are  nested  and  each  is  an  invariant  set,  a  trajectory  starting  from  the  bound¬ 
ary  of  Clk  will  stay  inside  Clk  and  will  never  go  back  to  This  guarantees  that  no  chattering 

will  occur  and  there  are  at  most  N  +  2  switches.  And  between  two  switches,  the  trajectory  is 
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uniquely  determined  by  the  place  where  the  first  switch  takes  place.  Hence  for  all  initial  states  m 
Dzw,  there  is  a  unique  trajectory  of  (28). 

Remark  2  Note  that  our  controller  u  =  g(z,w,a,N)  is  constructed  from  a  nonlinear  controller 
u  =  j(v)  and  a  linear  controller  u  =  Fx.  The  nonlinear  controller  is  used  to  keep  z-Vw  bounded 
and  it  determines  the  region  of  output  regulation.  The  linear  controller  is  used  to  drive  z  closer 
and  closer  to  zero.  We  may  also  replace  the  linear  controller  with  a  nonlinear  one  such  as  f(v) 
and  replace  £  with  a  general  level  set.  The  reason  we  have  used  a  linear  controller  is  for  simplicity 
of  both  analysis  and  the  switching  scheme. 

Prom  the  proof  of  Theorem  2,  we  see  that  for  all  (z0,  ™o)  £  Dzw,  the  number  of  switches  is  at 
most  N  +  2.  To  reduce  the  complexity  of  the  controller,  we  would  like  to  choose  N  as  small  as 
possible.  As  we  can  see  from  (24),  choosing  smaller  a  <  1  will  enable  smaller  N. 

For  better  understanding,  we  illustrate  the  proof  of  Theorem  2  with  Fig.  1.  The  sets  Dzw  for 
the  simplest  case  where  both  z  and  w  are  one  dimensional  are  plotted.  Here  we  have  X  =  V  -  1, 
a  =  0.6,  5  =  0.2  and  N  =  3.  The  parallelogram  bounded  by  the  straight  lines  Lk  (along  with  the 
two  vertical  lines  w  =  ±1)  is  Dkzw  =  {(z,w)  :  \z  -  akw\  <  ak ,  M  <  l}  =  °>  M,4-  The  dotted 
line  passing  through  the  origin  is  in  parallel  to  the  line  L0-  Suppose  that  (zo>wo)  &  D  C  Dzw, 
then  under  the  control  u  =  fo(z,w,a),  {z,w)  will  converge  to  the  dotted  line.  Since  a  is  chosen 
such  that  this  dotted  line  is  inside  D\w  (ref.  (29)),  (z,w)  will  enter  D\w  in  a  finite  time.  After 
that,  the  controller  will  be  switched  to  fi(z,w,  a)  and  so  on.  Finally  {z,w)  will  enter  D*w  and  z(t) 
will  go  to  zero.  If  z  is  two  dimensional,  we  will  have  cylinders  as  Dzw  instead  of  parallelograms. 


0.5 

o! 

-0.5 

-1 

-1.5 

-2 

-2.5 


^4  " 
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Figure  1:  Illustration  for  the  proof  of  Theorem  2 

In  what  follows,  we  will  deal  with  the  case  that  there  is  no  V  satisfying  —AV  +  VS  =  -BT. 
This  will  occur  if  A  and  S  have  some  same  eigenvalues  on  the  imaginary  axis.  The  following 
method  is  also  useful  in  the  case  that  some  eigenvalues  of  A  and  S  on  the  imaginary  axis  are  very 
close.  This  will  result  in  large  elements  of  V,  so  a  could  be  very  close  to  1  and  N  could  be  very 

large. 
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(30) 


Suppose  that  the  z-system  (4)  has  the  following  form, 


h 

’  A1 

0 

Zl 

+ 

'  Bi  ' 

Z2  _ 

0 

a2 

z 2  m 

b2 

BiT 

B2T 


with  A\  G  RniXni  semi-stable  and  A2  G  RnaX"2  anti-stable.  Also  suppose  that  there  is  a  known 
function  f(v2),  |/(v2)|oo  <  1  for  all  v2  G  Rn2  such  that  the  origin  of  the  following  system 


v2  =  A2v2  +  B2f(v2) 


has  a  domain  of  attraction  S2,  which  is  a  bounded  set.  Then  by  Lemma  2,  the  system 


v2  =  A2v 2  +  6B2f 


has  a  domain  of  attraction  5S2 ;  and  by  Teel  (1996)  there  exists 
the  origin  of 

v  —  Av  -f-  <5jBsat(/i(u)) 


a  control  u  =  8  sat {h(v))  such  that 


has  a  domain  of  attraction  Sg  =  R"1  x  8S2. 

Since  there  is  a  V2  satisfying  -A2V2+V2S  =  -B2T,  by  the  foregoing  development  of  Theorem  2, 
there  exists  a  controller  u  =  g(z2,w,a,N )  such  that  for  any  (zo,wo)  satisfying  z2o  V2wq  G  S2, 
w0  G  Wo,  the  response  of  the  closed-loop  system  satisfies  lim^OT  z2(t)  =  0.  Hence  there  is  a  finite 
time  h  >  0  such  that  z{h)  €  Rni  x  SS2.  After  that  if  we  switch  to  the  control  u  =  Tw  +  8 sat(h(z), 

we  will  have 

i  =  Az  +  <5J5sat(h(z)) 


and  z  will  stay  in  Sg  =  Rni  x  6S2.  To  avoid  the  possibility  that  the  state  z2  might  be  trapped  on 
the  boundary  of  SS2,  we  need  to  modify  the  controller  further  such  that  it  will  not  switch  before 
z2  bas  entered  7 6S2  for  some  7  G  (0, 1).  For  this  purpose,  we  introduce  a  switching  state  variable 


s{z2(t )): 


s(z2(t))  =  { 


0, 

1, 

s{z2(t  )), 


if  z2  G  Rn2  \  8S2, 
if  z2  G  7<5 S2, 
if  z2  G  SS2  \7 5S2, 


where  s(z2(t))  =  s(z2(t~))  means  that  s  does  not  change  value  at  t.  We  may  simply  assume  that 
s(0)  =  0.  Now  the  modified  controller  is, 


u 


g{z2 ,  w,  a,  N ),  if  z2  G  R"2  \  7^2  and  s  =  0, 

Tw  +  6  sat (h(z)),  if  z2  G  8S2  and  s  =  1. 


Since  g{z2,  w,  a,  N)  has  N  +  2  switches,  the  modified  controller  has  N  +  3  switches.  We  conclude 
that  under  this  control,  the  following  set 


Dzw  =  {(2,  w)  G  Rn  x  Wo  :  z2  -  V2w  G  <S2} 

will  be  a  subset  of  Szw.  The  argument  goes  as  follows.  Given  {zq,wo)  £  Dzw,  without  loss  of 
generality  assume  that  z20  G  R”2  \  ^2,  then  s(0)  =  0  and  u  =  g(z2,  w,  a,  N)  will  be  in  effect  and 
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by  Theorem  2  we  have  lim*-^  z2{t)  =  0.  So  there  is  a  finite  time  >  0  such  that  z2{h)  €  5S2. 
After  ii  we  still  have  s(z2{t))  =  0  so  the  controller  will  not  switch  until  z2(t2)  G  7^2  for  some 
t2  >  t\.  After  t2,  we  have  s(z2(i))  =  1  and  the  controller  will  switch  to  Tw  +  5 sat (/»(«)).  Under 
this  control  Rni  x  6S2  is  an  invariant  set  and  a  domain  of  attraction.  So  z2{t)  will  stay  in  5S2, 
s(z2(t ))  stays  at  1  and  we  have  lim^  z{t)  =  0.  Here  we  also  have,  if  <S2  =  C2,  then  Dzw  =  Hag. 

5  Error  Feedback 

Consider  again  the  open  loop  system  (4).  Here  in  this  section,  we  assume  that  only  the  error 
e  =  Cz  is  available  for  feedback.  Also,  without  loss  of  generality,  assume  that  the  pair 

(C,A)  =  flO  0],  ]) 

is  observable.  If  it  is  detectable,  but  not  observable,  then  the  unobservable  modes  must  be  the 
asymptotically  stable  eigenvalues  of  A,  which  do  not  affect  the  output  regulation  (see  (4))  and 
hence  can  be  left  out. 

Our  controller  consists  of  an  observer  and  a  given  state  feedback  law  u  =  f{v).  Because  of  the 
observer  error,  we  need  an  additional  assumption  on  f(v )  so  that  some  class  of  disturbances  can 
be  tolerated.  Consider  the  system 

v  =  Av  +  Bf{y  +  tj),  (31) 

where  r]  stands  for  the  disturbance  arising  from,  for  example,  the  observer  error.  Assume  that 
|/(u)lco  <  1  for  all  v  G  Rn  and  that  there  exist  a  set  D0  C  Rn  and  positive  numbers  7  and  d0  such 
that  the  solution  of  the  system  satisfies 

Moo  <  7 max  (|v0|oo,  Moo) ,  ||o||a  <  7NU,  Vu0  €  £>o,  IMloo  <  dQ, 

where  \\v\\a  =  limsup^  |u(t)|oo-  This  system  is  said  to  satisfy  an  asymptotic  bound  from  D0 
with  gain  7  and  restriction  d0  (Teel,  1996).  In  Hu  and  Lin  (2001b),  a  saturated  linear  feedback 
u  -  y(y)  =  sat(i?ov)  with  such  property  is  constructed  for  second  order  anti-stable  systems. 
Moreover,  the  set  D0  can  be  made  arbitrarily  close  to  the  null  controllable  region  C. 

Let  D  G  Rn  be  in  the  interior  of  D0,  i.e.,  the  distance  from  any  point  in  D  to  the  boundary  of 
Do  is  greater,  than  a  fixed  positive  number.  Given  a  number  M,  denote 

Dm  =  ^(z,w,z,w)  G  Rn  x  Wo  x  Rn+r  :  z-VweD ,  !  <m|, 

where  (z,w)  denotes  the  observer  error.  It  is  clear  that  the  set  Dm  increases  as  D  increases. 
Prom  Theorem  1,  we  see  that  if  D  =  Ca,  then  the  projection  of  DM  to  the  (z,  w) -subspace  equals 
to  7Za.  To  enlarge  the  set  of  initial  conditions  where  output  regulation  is  achieved,  it  suffices  to 
construct  a  state  feedback  law  u  =  f(v)  to  enlarge  D0,  choose  a  set  D  very  close  to  D0  and  design 
an  observer  such  that  for  all  (z0,w0, z0,w0)  G  DM,  lim^oo  z(t)  =  0.  The  objective  in  this  section 
is  to  construct  such  an  observer  given  u  =  f(v),  Do  and  D  in  the  interior  of  Dq. 
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We  use  the  following  observer  to  reconstruct  the  states  z  and  w, 

z  =  Az  +  Bu  —  BTw  —  Li(e  —  Cz),  (32) 

w  =  Sw  -  L^e  -  Cz).  ’ 

Letting  z  =  z  —  z,w  =  w  —  w,  we  can  write  the  composite  system  as 


z  =  Az  +  Bu  —  BTw, 
w  =  Sw, 

z  _  A  +  L\C  —BT  z 
w  LiG  S  w 


(33) 


Now  we  have  to  use  (z,  w)  instead  of  (z7  w)  to  construct  a  feedback  controller.  Since  ( C ,  A)  is 

_ i- 1  _  _ _ _ r  F  A  1  _ _ •  _ /u  ~ _ 4.: _ 4.: _ _ —  (  z  *r.\  _ 


observable,  we  can  choose  L 


appropriately  such  that  the  estimation  error  (z,  w)  decays 


arbitrarily  fast.  Moreover,  the  following  fact  is  easy  to  establish, 


Lemma  4  Denote 

t  \  A  +  LiC  -BF 

A=[  l2c  s 

Given  any  (arbitrarily  small)  positive  numbers  T  and  there  exists  an  L  such  that 

max  ||e^| ,  \L\  •  |e^||  <  e,  Vt  >  T, 
where  j  *  |  can  be  any  matrix  norm. 

Because  of  this  lemma,  it  is  expected  that  the  controller  based  on  the  observer  can  achieve 
almost  the  same  performance  as  the  state  feedback  controller. 

Consider  system  (33).  For  simplicity,  we  also  assume  that  (18)  is  satisfied.  Letting  v  ~  z  —  Vw , 
we  obtain  v  =  Av  +  Bu.  Suppose  that  (z0,  u>o?  ^o?  ^o)  €  Dm,  then  vq  =  zo  —  Vwo  G  D.  Since  D  is 
in  the  interior  of  Do?  there  exists  a  To  >  0  such  that,  with  any  admissible  control  u,  we  have 

v(t)  =  z{t)  -  Vw(t)  e  D0,  Vi  <  T0.  (34) 


What  we  are  going  to  do  is  to  choose  L  such  that  the  estimation  error  is  sufficiently  small  after 
To,  and  to  design  switching  feedback  laws  to  make  z(t )  ->  akVw(k)  with  increasing  k  and  finally 
drive  z(t)  and  z(t)  to  the  origin. 

Lemma  5  There  exists  an  L  E  R(  n+r)xq  fhaf,  under  the  control 


(  ui(t),  t  <  To, 

{  f(z-Vw),  t>T0, 


where  u\  is  any  admissible  control,  the  solution  of  system  (33)  satisfies 


Hm  ( z(t )  —  Vw(t ))  =  0, 


V  (z0,wo,zq,wo)  e  Dm- 
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Proof.  Let  v  =  z  —  Vw.  Since  ui  is  an  admissible  control,  we  have  (34) .  In  particular, 

v(Tq)  =  z(T0)  -  Vw(T0)  G  D0.  (35) 

Let  v  =  z  —  Vw,  by  Lemma  4,  there  exists  an  L  G  R.(n+r)x9  such  that  for  all  (zo,  wo,zo,  wo)  e 

|ij(i) joo  =  \z{t)  ~  Vwit)^  <  do,  Vi>T0.  (36) 

We  now  consider  the  system  after  T0.  For  t  >  T0,  we  have  u  =  f(z-  Vw)  and  the  closed-loop 
system  is 

V  =  Av  +  Bf(z  -  Vw)  =  Av  +  Bf(v  -  v ),  v{T0)  G  D0. 

By  assumption,  this  system  satisfies  an  asymptotic  bound  from  D0  with  a  finite  gam  and  restriction 
do.  It  follows  from  (35),  (36)  and  limt_>0oi>(i)  =  °> tliat  linot-KsoW*)  ~  Vw(t))  =  limt_4oo  v(t)  =  0. 

Lemma  5  means  that  we  can  keep  z{t)  bounded  if  {z0,wq,z0,wo)  €  DM.  Just  as  the  state 
feedback  case,  we  want  to  move  z{t)  to  the  origin  gradually  by  making  z{t)  -  ak  Vw(t)  small  with 
increased  k.  Due  to  the  switching  nature  of  the  controller  and  that  the  feedback  has  to  be  based 
on  {z,w),  we  need  to  construct  a  sequence  of  sets  which  are  invariant  with  respect  to  (z,w)  rather 

than  (z,  w)  under  the  corresponding  controllers. 

Using  linear  system  theory,  it  is  easy  to  design  an  F  G  RmX7\  along  with  a  matrix  X  >  0  such 
that  A  +  BF  is  Hurwitz,  that  S  =  {v  G  R"  :  v*Xv  <  1}  C  {u  G  Rn  :  \Fv\^  <  1}  and  that  for 
some  positive  number  d\ ,  £  is  invariant  for  the  system 

V  =  Av  +  Bs&t(Fv)  -  T],  I77I00  <  d\.  (37) 

Let  a  and  N  be  determined  from  X  in  the  same  way  as  with  the  state  feedback  controller. 
With  F  €  Rmxn,  we  form  a  sequence  of  controllers, 

u  =  fk(z,  w,  a)  =  {  1  -  ak) Tw  +  afcsat  ^  .  k  =  0,l,---,N, 

and  _  (Fz\ 

u  =  fN+i{z,  w)  =  Tw  +  S sat  J  . 

Under  the  control  u  -  fk{z,  w,  a),  consider  vk  =  z-  akVw,  then  we  get 

vk  =  Avk  +  akB  sat  -  (Li  -  akVL2)Cz.  (38) 

Note  the  difference  between  this  equation  and  the  corresponding  (27)  in  the  state  feedback  case. 
Here  we  need  to  take  into  account  the  extra  term  (Li  -  akVL2)Cz.  For  clarity,  we  split  the 
discussion  into  three  cases. 

Case  1.  k  =  0.  Let  v  =  2  -  Vw.  Then  the  system 

v  =  Av  +  Bsat(Fu)  —  (Li  —  VL2)Cz, 
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has  an  invariant  set  £  for  all  z  satisfying 


Pi  -  VL2)Cz loo  <  dx. 


(39) 


Since  lim*-^  z(t)  =  0,  we  also  have  limt-,^,  u(t)  =0  Vuo  €  £• 

Case  2.  0  <  k  <  N.  Similar  to  Lemma  3,  we  have  an  invariant  set  ak£  for  the  system  (38)  under 
the  restriction 


-  akVL2)Cz  <  ukdi 


(40) 


Also,  because  lim^oo  z(t)  =  0,  we  have  lim^oo  Vk(t)  =  0  for  all  vq  €  ak£. 
Case  3.  k  =  N  +  1.  We  have  an  invariant  set  S£  for  the  system 


under  the  restriction 


z  =  Az  +  SB  sat 


LrCz 


\L\Cz\oo  <  Sdi. 


(41) 


Now  we  define  a  sequence  of  sets  in  Rn  x  Rr: 


Dkzw  =  {(*,™)  G  R"  x  Rr  :  2  -  akVw  €  ak£j  ,  k  =  0, 1,2,-  ••  ,N, 

and 

Dg*1  =  {(z,  w)£R"xRr:i£K). 

A  counterpart  of  Lemma  3  is, 


Lemma  6  Suppose  that  F  is  chosen  such  that  £  is  invariant  for  the  system  (37)  and  that  L 
and  z o  are  such  that  z  satisfies  all  the  conditions  (39),  (40)  and  (41).  Then,  under  the  control 
u  =  fk(z,  w,  a),  the  set  is  invariant  for  the  system  (32)  and  lim^oo  (z(t)  —  akVw(t)^  =  0. 


With  the  preliminaries  we  developed  above,  we  can  now  construct  an  error  feedback  law  as 
follows: 


u  —  g(z,  to,  a,  N)  -  < 


f  fN+i{z,w),  if  (z,w)  €  ttN+1, 

fk(z,w,a),  if  (z,w)  €  Clk \£lk+1,  k  =  0,l,...,N, 
[  f(z  -  Vw),  if  (z,  w)  €  Rn  x  Rr  \  fi°. 


(42) 


where  flk  =  k  =  0,1,...  ,N  +  1. 

Suppose  that  the  controller  (42)  is  connected  to  system  (33).  At  t  =  To,  we  have  z(Tq)  — 
Vw(Tq)  €  Dq  (cf.  (34)).  To  apply  Lemma  6  for  t  >  To,  we  have  to  ensure  that  all  the  conditions 
(39),  (40)  and  (41)  are  satisfied.  Moreover,  we  also  require  that 


|/k(2,w,a)|oo  <  1,  l/tf+i&tiOloo  <1- 


(43) 


Note  that 


\fk{z,  w,  a)  |oo  = 


i'F(z  -  akVw)\ 


(1  —  ak)Vw  +  orsat 


or 


<  1 
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can  be  satisfied  if 


|rtD|oo  <  +  ir^ioo  <  1.  (44) 

Let  do  and  d1  be  given,  then  by  Lemma  4,  all  the  conditions  (36),  (39),  (40),  (41)  and  (44)  can  be 
satisfied  for  t  >  Tq  by  suitably  choosing  L.  Note  that,  in  (44),  |r^|oo  <  P  <  1- 

Theorem  3  Consider  the  feedback  system  (S3)  with  (42).  Let  /(•)  be  chosen  such  that  the  system 
(31)  satisfy  an  asymptotic  bound  from  D0  with  finite  gain  and  restriction  d0.  Let  D  be  a  set  in 
the  interior  of  D0  and  T0  be  chosen  such  that  (34)  is  satisfied.  Let  F  be  chosen  such  that  £  is 
invariant  for  the  system  (37)  and  let  L  be  chosen  such  that  the  conditions  (36),  (39),  (40),  (41) 
and  (44)  are  satisfied  for  t  >  Tq.  Then  for  all  (z0,wo,z0,wo)  €  Dm,  hmt-yoo  z(i)  =  0. 

Proof.  Case  1.  {z(T0),w(To))  6  Rn  x  Rr  \  £ l °-  Then  u  =  f(z-  Vw)  will  be  in  effect.  This  is 
just  the  situation  described  in  Lemma  5.  So  we  have  \imt^oo(z(t)  -  Vw{t))  =  0  and  similar  to  the 
proof  of  Theorem  2,  it  can  be  shown  that  {z,  w)  will  enter  fi°,  or  some  other  9lk  at  a  finite  time. 
Case  2.  (z{To),w(To))  €  £lk  \  9lk+1.  Since  z(t),t  >  To  satisfies  the  conditions  (39),  (40)  and  (41), 
each  Dkm  is  invariant  under  the  control  u  =  fk{z,w,a).  Since  limt_>oo^W  =  0>  we  have  (see  38) 
lim^oo  (z(t)  -  akVw(t))  =  limbec  vk(t)  =  0.  Similar  to  the  proof  of  Theorem  2,  it  can  be  shown 

that  ( z,w )  will  enter  £lkl  for  some  kx>  k. 

By  repeating  this  procedure,  we  will  have  {z,w)  €  Q.N+l  at  some  finite  time,  and  hence 
limt  )00  z(t )  =  0.  Also,  since  limt_>oo  2{t)  =  0,  we  have  limt_^oo  z(t)  =  0.  D 


6  Example 


In  this  section,  we  will  apply  the  results  developed  above  to  the  control  of  an  aircraft  model. 
Consider  the  longitudinal  dynamics  of  the  TRANS3  aircraft  under  certain  flight  condition  (Junkins, 


Valasek  and  Ward,  1999), 


x  —  Ax  4-  Bu, 
y  =  Cx, 


(45) 


with 

0  14.3877  0  -31.5311 

-0.0012  -0.4217  1.0000  -0.0284 

A~  0.0002  -0.3816  -0.4658  0 

0  0  1.0000  0 


B  =  0.1745  x 


4.526 
-0.0337 
-1.4566  ’ 

0 


and  C  —  [1  0  0  0],  where  the  state  consists  of  the  velocity  x\  (feet/s,  relative  to  the  nominal 
flight  condition),  the  angle  of  attack  x2  (degree),  the  pitch  rate  x3  (degree/s)  and  the  Euler  angle 
rotation  of  aircraft  about  the  inertial  y-axis  x4  (degree),  the  control  u  (degree)  is  the  elevator 
input,  whose  value  is  scaled  to  between  ±1  (corresponding  to  ±10°).  The  design  objective  is  to 


reject  disturbances  Pvj,  where 


-0.6526 

-0.3350 

0.4637 

0.9185 

0.0049 

0.0025 

-0.0035 

-0.0068 

0.2100 

0.1078 

-0.1492 

-0.2956 

0 

0 

0 

0 
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and  w  contains  the  frequencies  of  0.1  rad/s  and  0.3  rad/s.  Clearly,  this  problem  can  be  cast  into 
an  output  regulation  problem  for  the  system  (1)  with 


S  =  diag 


0  -0.1 

0.1  0 


0 

0.3 


-0.3 

0 


and  Q  —  0.  A  solution  to  the  linear  matrix  equations  (2)  are 

II  =  0,  r=  [  0.8263  0.4242  -0.5871  -1.1630  ] . 

Assume  that  the  disturbances  are  bounded  by  ||r«-!]|oo  <  P  =  0-9-  Thus  6  =  0.1.  Since  II  —  0,  we 
have  z  =  x  —  Iln;  =  x. 

The  matrix  A  has  two  stable  eigenvalues  —0.4650  ±  0.6247?  and  two  anti-stable  ones,  0.0212  ± 
0.1670?.  With  state  transformation,  we  get  the  matrices  for  the  anti-stable  subsystem: 

8.2856 
-2.4303  ' 

We  don’t  need  to  worry  about  the  exponentially  stable  Zi-subsystem  since  its  state  is  bounded 
under  any  bounded  input  u-Tw  and  will  converge  to  the  origin  as  the  combined  input  goes  to 
zero.  We  now  investigate  two  types  of  controllers. 

Case  1.  The  state  feedback. 

With  the  design  method  in  Hu  and  Lin  (2001a),  we  obtain  a  semi-global  stabilizer  u  =  f(z2 )  = 
sat (/3F0z2),  Fo  =  [  -0.0093  0.0041  ]  for  the  system  in  the  absence  of  disturbance.  With  0  =  1, 
the  achieved  domain  of  attraction  is  very  close  to  the  null  controllable  region  (see  Fig.  2,  where 
the  outermost  solid  close  curve  is  the  boundary  of  C2  and  the  dotted  closed  curve  is  the  boundary 
of  the  domain  of  attraction  S2). 

With  the  method  proposed  in  Section  3,  we  take  F  =  F0  and  the  switching  parameters  be 
a  =  0.4  and  N  =  3.  So  there  are  at  most  5  switches  in  the  controller  u  =  g(z2,w,a, 3).  The 
closed- loop  system  is  simulated  with  z2o  —  V2wq  very  close  to  the  boundary  of  S2  (see  the  point 
marked  with  “o”  in  Fig.  2).  The  trajectory  shown  in  the  figure  is  that  of  z2(t)  with  the  initial 
state  marked  with  We  note  here  that  the  initial  state  z20  is  not  always  inside  <S2,  not  even 
inside  the  null  controllable  region.  But  z2o  -  V2wq  has  to  be  in  the  null  controllable  region,  i.e., 

(z2o ,  u>o)  has  to  be  in  the  regulatable  region  %gv 

The  output  e  =  Cz  is  plotted  in  Fig.  3.  The  control  (solid  curve)  and  the  switching  history 
(dash-dotted  curve)  are  plotted  in  Fig.  4,  where  for  the  dash-dotted  curve,  the  number  —0.2 
indicates  the  control  u  =  f{z2-  V2w)  =  sat(F(z2  -  V2w))  is  applied  and  the  number  0.2 k,  indicates 
that  the  controller  u  =  fk(z2,w,a)  is  applied,  k  =  0, 1,  -  •  •  ,4,  respectively.  We  see  that  the 
controller  u  =  f3(z2,w,a)  is  skipped.  This  is  because  that  the  set  Clk+l  as  a  subset  of  Q,k  may 
share  some  bounary  points  with  iik  (see  Fig.  1). 

Case  2.  The  error  feedback 


A2  = 


0.0212 

-0.1670 


0.1670 

0.0212 
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300 1 


Figure  2:  A  trajectory  of  z2  -  Case  1 


.Figure 


- JT 


Here  we  assume  that  only  the  error  signal  is  available.  So  we  need  to  build  an  observer  to 
reconstruct  the  plant  and  exosystem  states.  For  this  system,  (  C  0  j ,  ^ 


0 

er  u 


S 

■■  f(v  2) 


is  observ- 


=sat(Fbu2), 


able.  With  the  design  method  in  Hu  and  Lin  (2001b),  we  obtain  a  controll 
F0  =  J  -0.0175  0.0103  ]  such  that  the  system  v2  =  +  B2f(v2  +  77)  satisfies  an  asymptotic 

bound  from  Dq  with  a  finite  gain  and  nonzero  restriction,  where  Do  is  also  very  close  to  the  null 
controllable  region  (see  Fig.  5,  where  the  outermost  solid  close  curve  is  the  boundary  of  C2  and 
the  dotted  closed  curve  is  the  boundary  of  Do)- 

With  the  error  feedback  design  method  proposed  in  this  paper,  we  obtain  for  the  anti-stable 
sub-system  F  =  [—0.0378  0.0357]  and  the  switching  parameters  a  =  0.5  and  N  =  3.  Also,  to 
achieve  fast  recovery  of  the  state,  we  choose 


L  =  [24.11  -263.61  68.59  -115.96  161070.21  -231551.67  65778.10  -3347.56f, 
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Figure  4:  The  control  and  the  switching  history  —  Case  1 


for  the  observer. 

The  closed-loop  system  is  simulated  with  Z20  —  Vwq  very  close  to  the  boundary  of  Do,  see 
the  point  marked  with  “o”  in  Fig.  5.  We  simply  set  the  initial  states  of  the  observer  be  0.  The 
trajectory  shown  in  the  figure  is  that  of  22(f),  with  the  initial  point  marked  with 

The  error  output  e  =  Cz  is  plotted  in  Fig.  6  and  the  observer  error  is  plotted  in  Fig.  7.  The 
control  and  the  switching  history  is  plotted  in  Fig.  8.  The  simulation  results  verify  the  effectiveness 
of  the  design  method  proposed  in  this  paper. 


Figure  5:  The  trajectory  of  Z2  —  Case  2 


7  Conclusions 

In  this  paper,  we  have  systematically  studied  the  problem  of  output  regulation  for  linear  systems 
subject  to  actuator  saturation.  The  plants  considered  here  are  general  and  can  be  exponentially 
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Figure  6:  The  error  output  e  —  Cz  Case  2 


Figure  7:  The  observer  error  z  and  w  —  Case  2 


unstable.  We  first  characterized  the  regulatable  region,  the  set  of  initial  conditions  of  the  plant 
and  the  exosystem  for  which  output  regulation  can  be  achieved.  Based  on  a  given  stabilizing  state 
feedback  law,  we  then  constructed  a  state  feedback  law  and  an  error  feedback  law,  that  achieve 
output  regulation  on  a  subset  of  the  regulatable  region.  The  size  of  this  subset  depends  on  the 
domain  of  attraction  under  the  given  stabilizing  state  feedback  law. 
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Abstract 

This  paper  considers  the  problem  of  robust  filtering  for  discrete-time  linear  systems  sub¬ 
ject  to  saturation.  A  generalized  dynamic  filter  architecture  is  proposed  and  a  filter  design 
method  is  developed.  Our  approach  incorporates  the  conventional  linear  H2  and  ifoo  fil¬ 
tering  as  well  as  a  regional  l2  gain  filtering  feature  developed  specially  for  the  saturation 
nonlinearity,  and  is  applicable  to  the  digital  transmultiplexer  systems  for  the  purpose  of  sep¬ 
arating  filter  bank  design.  It  turns  out  that  our  filter  design  can  be  carried  out  by  solving  a 
constrained  optimization  problem  with  LMI  constraints.  Simulation  shows  that  the  resultant 
separating  filters  possess  satisfactory  reconstruction  performance  while  working  in  the  linear 
range,  and  less  degraded  reconstruction  performance  in  the  presence  of  saturation. 
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1  Introduction 


Digital  filtering  systems  are  inherently  subject  to  nonlinear  effects  such  as  adder  overflow  and 
amplitude  saturation  [7,  19].  These  nonlinearities  may  introduce  limit  cycles  to  the  system.  As 
seen  in  the  literature,  efforts  have  been  dedicated  to  the  stability  issue  where  the  generalized 
overflow  nonlinearity  as  described  in  Fig.  1  is  considered  (see,  e.g .,  [3,  18]).  The  saturation 
nonlinearity  brought  about  by  magnitude  truncation  falls  into  this  category  and  can  be  regarded 
as  a  special  case  in  which  L  =  1.  In  [18]  and  [20],  conditions  for  global  asymptotic  stability  are 
given  in  regard  to  systems  with  generalized  overflow  characteristics  and  systems  with  partial 
state  saturation,  respectively. 


Figure  1:  The  generalized  overflow  nonlinearity. 

Beyond  stability,  the  second  important  issue  to  address  is  the  performance.  In  particular, 
when  both  noise  and  saturation  are  present  in  the  digital  system,  we  would  like  to  design  a 
filter  such  that  a  certain  cost  function  from  the  noise  to  the  filtering  error  is  minimized.  As  far 
as  linear  systems  are  concerned,  besides  the  traditional  Kalman  filter,  the  H2  and  filtering 
has  also  gained  popularity  [2,  8,  11,  15,  22].  It  is  noteworthy  that  some  work  has  been  done 
with  general  nonlinear  systems  [9,  23].  Earlier,  results  on  systems  represented  by  state-space 
models  are  usually  given  in  the  form  of  Riccati  equations  (e.#.,  [9,  23]).  In  recent  years,  authors 
have  been  casting  linear  H2  and  filter  design  into  constrained  optimization  problem  with 
linear  matrix  inequality  (LMI)  constraints  [10,  21,  24],  which  leads  to  increased  tractability  and 
greater  convenience. 

In  our  work,  we  will  treat  discrete-time  systems  with  saturation  and  additive  noise  in  state- 
space  model,  propose  a  dynamic  filter  structure,  and  develop  a  framework  in  which  the  filter 
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Figure  2:  Noise-free  TDM-FDM  transmultiplexer. 

design  could  be  carried  out  by  solving  an  LMI  constrained  optimization  problem.  We  will  also 
apply  the  proposed  method  to  a  digital  transmultiplexer  system  to  design  a  separating  filter 
bank. 

In  communication  systems,  it  is  often  necessary  to  transmit  several  data  signals  through 
one  common  physical  medium,  as  with  cellular  phone  systems,  telephone  systems,  etc.  Such 
necessity  gives  rise  to  the  transmultiplexer  systems.  Fig.  2  shows  a  conventional  noise-free 
multirate  transmultiplexer  with  M  bands  [16].  M  time  division  multiplexed  (TDM)  data  signals 
are  expanded  by  a  factor  of  N  and  processed  by  a  combining  filter  bank  and  summed  up  to 
become  a  single  frequency  division  multiplexed  (FDM)  signal  for  transmission.  The  received 
signal  passes  through  the  separating  filter  bank  to  become  M  data  signals  again,  which  are 
decimated,  and  converted  back  to  M  TDM  signals.  Here  the  channel  is  assumed  to  be  ideal 
in  that  its  transfer  function  is  identity  up  to  some  constant  gain  and  fixed  time-delay.  In  such 
a  system,  crosstalk  may  occur  due  to  the  decimation  and  imperfect  filters  which  result  in  not 
perfectly  reconstructed  data.  In  the  noise-free  case  with  ideal  channel,  crosstalk  cancellation  is 
achievable  with  proper  design  of  the  combining/separating  filter  banks  [1,  16].  However,  these 
works  did  not  consider  the  effect  of  channel  distortion  (linear/ nonlinear  filtering,  fading,  channel 
nonlinearities,  etc),  which  is  often  encountered  in  communications  systems  including  wireless 
communication  and  fiber  optic  communication.  Also,  in  digital  transmultiplexer  systems,  the 
quantization  error  in  coding  and  external  disturbances  to  the  channel  (both  could  be  viewed  as 
noise)  are  ubiquitous.  Therefore  in  practice,  perfect  reconstruction  of  data  is  not  achievable.  To 
deal  with  the  problem  in  the  presence  of  linear  time-invariant  channel  distortion  and  additive 
noise,  in  [6]  a  mixed  II 2 /  H 00  filtering  design  scheme  is  provided  in  the  state  space  framework 
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which  yields  a  satisfactory  reconstruction  performance  and  is  shown  to  be  more  robust  than  the 
Kalman  filter  [17].  However,  previous  works  assumed  the  transmultiplexer  system  to  be  working 
under  the  linear  condition  such  that  the  effect  of  possible  amplitude  saturation  (which  could 
take  place  either  in  the  power  amplifier,  within  the  transmission  channel  or  at  the  receiver)  is 
ignored.  In  this  work,  we  will  take  amplitude  saturation  into  account  and  design  a  filter  that, 
in  the  absence  of  saturation,  minimizes  the  H2-  &nd  iJoo-norms  of  the  transfer  function  from 
the  noise  to  the  reconstruction  error,  and  in  the  presence  of  actuator  saturation,  minimizes  the 
regional  l2  gain  from  the  noise  to  the  reconstruction  error.  We  thus  refer  to  our  filter  design 
as  an  hybrid  design  method  which  is  expected  to  result  in  less  degraded  reconstruction  in  the 
presence  of  both  saturation  nonlinearity  and  additive  noise. 

This  paper  is  organized  as  follows.  Section  2  states  the  problem  as  well  as  reviews  some 
preliminary  results  on  linear  filtering.  Section  3  presents  our  hybrid  design  method  with  consid¬ 
eration  of  amplitude  saturation.  Section  4  includes  an  application  of  our  proposed  hybrid  filter 
design  method  to  the  separating  filter  bank  design.  Section  5  concludes  the  paper. 

Throughout  the  paper,  we  will  use  the  following  notation.  For  a  vector  x  £  Rn,  \\x\\  denotes 
its  Euclidean  norm.  Let  l2  denote  the  set  of  discrete-time  signals  such  that 

oo 

£||l(*)f<00. 

Jfc=0 

For  any  x  Eh,  the  Z2-norm  is  defined  as 


For  an  asymptotically  stable  transfer  function  G(z),  we  use  ||(?||2  and  Halloo  to  denote  its  II 2- 
norm  and  .ffoo-norm,  respectively. 

2  Problem  Statement  and  Preliminaries 

In  this  section,  we  will  first  precisely  state  the  problem  we  are  to  address  in  this  paper  and  then 
recall  some  preliminaries  on  the  linear  H2  and  ffoo  filtering. 

2.1  Problem  Statement 

Consider  a  discrete-time  linear  time-invariant  system  in  the  presence  of  input  noise  v,  measure¬ 
ment  noise  w  and  saturation 

x(k  + 1)  =  Ax(k)  +  Bv{k),  x£Rn,v€Rm, 

r(k)  =  sa,t(Gx(k))  +  Ew(k),  r  6  Rp,iJ)  £  R1,  (1) 

u(k )  =  Dx(k),  u  €  R9, 
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where  x  is  the  state  variable,  r  is  the  measured  output  and  u  is  the  signal  to  be  reconstructed 
by  some  digital  filter.  The  saturation  function  sat  :  Rp  -»•  Rp  is  defined  as 

sat(u)  =  [  sat(ui),sat(u2),  •  •  •  ,  sat (um)  ]  , 

with  sat(tti)  =  sgn(u{)  min{l,  |ui|}.  Here  we  have  assumed,  without  loss  of  generality,  that  the 
saturation  level  is  unity.  We  have  also  slightly  abused  the  notation  by  using  sat  to  denote  both 
the  scalar  valued  and  the  vector  valued  saturation  functions. 

Instead  of  using  an  observer  based  filter  structure  as  in  [6], 


x(k  +  1)  =  Ax(k)  +  K[r(k)  —  (?£(&)],  x  €  R  , 
u(k)  =  Dx(k),  R9, 

we  adopt  the  following  more  general  dynamic  filter,  to  be  denoted  as 

x(k  + 1)  =  Af£(k)  +B/r(k),  x  €  Rn,  ^2) 

u(fc)  =  Dfx(k),  u  €  R9, 

where  u{k )  is  the  reconstruction  of  u{k).  Define  the  filtering  error  (or  reconstruction  error)  as 


u(k)  =  u(k )  -  u{k). 


Introducing  a  new  variable  x  which  is  composed  of  x  and  x,  and  a  new  variable  w  consisting 
of  v  anH  w,  the  overall  system  can  be  written  as 


£(fc  +  l)  =  Ax(k)  +  Ba  (Fx(k))  +  Ew{k), 
u(k)  =  Cx(k), 


(3) 


where 


A  = 


A  0 
[0  Af\ 


,B  = 


0 

[Bf\ 


F=[a  B°tE]’C  =  lD  ~Dt\- 


Note  that  in  the  absence  of  saturation,  the  system  (3)  simplifies  to 

x(k  + 1)  =  A.Lx{k)  +  Ew(k), 

u(k)  =  Cx(k), 


(4) 


where  _ 

T  _  A  ° 

Al  ”  [  BjG  Af  J  • 

Our  objective  is  to  reconstruct  u(k)  from  the  received  signal  r(k)  which  is  corrupted  by 
additive  noise  and  amplitude  saturation,  and  minimize  the  reconstruction  error  u(k)  according 
to  certain  filtering  criterion. 
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2.2  Linear  H2  and  H0 0  Filtering 

Consider  the  discrete-time  linear  system  (1)  and  the  dynamic  filter  iF{Af,  Bf ,  Dj )  that  are  both 
free  of  saturation.  The  overall  state-space  representation  is  given  by  (4).  The  transfer  function 
from  the  noise  w  =  [uT,  tt/T]T  to  filtering  error  u  is  then 

G{z)  =  C{zI-Al)-1E. 


The  objective  of  filtering  design  is  to  make  this  transfer  function  as  “small”  as  possible.  Two 
popular  measure  of  the  size  of  a  transfer  function  are  its  if2-norm  and  H^-norm. 

The  ff2-norm  of  an  asymptotically  stable  and  proper  discrete-time  transfer  function  G{z)  is 
defined  as  [5] 

||G||2  :=  (^trace 

where  GH  (e-7u;)  is  the  complex  conjugate  transpose  of  G{e^).  By  Parseval  Theorem, 


||G||2  =  trace 


^2g(k)gT(k) 

,k= 0 


where  g(k)  is  the  unit  impulse  response  of  G(z).  Thus,  the  H2  norm  of  a  transfer  function 
measures  the  energy  of  its  unit  impulse  response. 

The  ffoo-norm  of  an  asymptotically  stable  and  proper  discrete-time  transfer  function  G{z) 
is  defined  as  „  ,, 


IIGIloo  :=  sup  amax  [G(ju)]  =  sup  tt  . 

we[0,25r]  ||w||a=l  IMU 


where  amax(G!(eJW)  is  the  maximum  singular  value  of  G(eJW),  h  is  the  response  of  G(z)  to  the 
input  w.  Clearly,  norm  of  a  transfer  function  is  the  maximum  energy  gain  from  the  input 
signal  to  the  output  signal  of  the  system  the  transfer  function  represents.  In  other  words,  if  the 
transfer  function  G(z)  has  an  iJ^-norm  of  7,  then  the  output  h  of  the  system  to  an  input  w  E  l2 
satisfies, 

IHI2  <  7IMI2- 


The  H2  and  Hoo  filtering  problem  can  then  me  formulated  as  follows.  For  an  a  priori  given 
7  >  0,  construct  a  filter  T{Af,Bf,Df)  such  that  the  resulting  transfer  function  G{z)  from  the 
noise  w  to  the  filtering  error  u  satisfies 


||G||2<7  or  ||G||oo<7- 

We  recall  the  following  results  on  the  H2  and  H0 0  filtering  problems,  respectively. 
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Lemma  1  [6,  21]  For  the  discrete-time  linear  system  (4),  the  H2-norm  of  its  transfer  function 
G{z)  is  less  than  or  equal  to  7  >  0  if  and  only  if  there  exists  a  matrix  R  =  RT  >  0  such  that 

ALRAl-R  +  EET  <  0,  (5) 

OLTlct 

trac e{CRCT)  <  72-  (6) 

Lemma  2  [21]  For  the  discrete-time  linear  system  (4),  the  Fl^-norm  of  its  transfer  function 
G(z)  is  less  than  or  equal  to  7  >  0  if  and  only  if  there  exists  a  matrix  P  =  PT  >  0  such  that 

P  0  AlP  Cr 

0  7/  ETP  0 

PAl  PE  P  0 

C  0  0  -yl 

3  A  Hybrid  Approach  to  Robust  Filtering 

3.1  Stability  Analysis 

The  Hi  and  filtering  as  recalled  in  Section  2.2  applies  only  to  linear  systems.  However  when 
saturation  takes  place  we  have  to  seek  other  filtering  criterion  as  the  performance  measure.  In 
what  follows,  we  will  introduce  the  concept  of  regional  l2  gain  filtering  and  develop  the  relevant 
analysis  and  design  procedures. 

Consider  the  following  discrete-time  system  in  the  presence  of  amplitude  saturation  and 
unknown  additive  disturbance 

x(k  +  1)  =  Ax(k)  +  By(k)  +  Ew(k),  x  eH2n,ui  eRm+l, 

y(k)  =  sat {Fx(k)),  y  €  Rp,  (8) 

u(k)  =  Cx(k ),  u  €  R9, 

where  x  is  the  state  variable,  w  is  an  unknown  disturbance  satisfying  wTw  <  1,  and  u  is  the 
filtering  error.  To  facilitate  our  development,  we  need  to  recall  the  following  definition. 

Definition  1  [14]  A  memoryless  nonlinearity  tp  :  [0,  oo)  x  Rp  -4  Rp  is  said  to  satisfy  a  sector 
condition  if 

[ip{t,  y)  -  Kminy]T  [<p(t,  y)  -  Kmaxy }  <0,  Vi  >  0,Vy  €  T  C  Rp,  (9) 

for  some  real  matrices  Km\n  and  Kmax,  where  K  —  Kmax  —  Amin  is  a  positive  definite  symmetric 
matrix  and  the  interior  of  T  is  connected  and  contains  the  origin. 
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Assuming  that  Ai  and  A2  are  diagonal  matrices  such  that  0  <  Aj  <  I  <  A2,  and  that 
(A  +  A \F)  is  stable,  one  can  write 

sat  ( Fx )  =  Ai Fx  A^p(x). 


Define 

£(A XF)  :=  {x  :  KAxP)^  <  1,V«}, 

in  which  (Ai F)i  is  the  ith  row  of  AiP.  Denote  A  :=  A2  —  Ai,  then  satisfies  a  sector 

condition  with  Kmm  =  0,  Km ax  =  A F  and  T  =  C(A-iF). 

Our  analysis  goal  here  is  to  establish  a  condition  under  which  an  ellipsoid  £l(P,p)  =  {x  € 
Rn  :  xTPx  <  p}  is  invariant.  A  set  is  said  to  be  invariant  if  any  trajectory  starting  from  within 
it  will  remain  inside. 

Let  P  be  a  positive  definite  matrix,  define  the  Lyapunov  function  candidate 

V(x)  =  xTPx. 

Denote 

AV(x(k))  =  V(x(k  +  1))  -  V(x(k)). 

In  order  for  the  set  0(P,  p)  to  be  invariant,  we  need  to  show  that 

A V(x(k)  <  0,  Vx(k)  G  df i(P,  p), 

where  d£l(P,p)  denotes  the  boundary  of  the  set  Cl(P,p).  Recalling  that  satisfies  a  sector 

condition  and 

tf£(i)[%(i)  -  A  Fx]  <0,  Vi  G  £(AXP). 

Assuming  that  f 1(P,  p)  C  £(Ax P),  we  obtain  the  following  inequality 

V{x{k  +  1)) 

<  iT(fc  +  1  )Px(k  +  1)  -  (i  ( k ))  [' $p  (i  (k))  -  A  Fx  (A:)] 

=  [{A  +  BAiF)  x(k)  +  BVp  (i(k))  +  Ew{k)]rP  [(. A  +  BAXF)  x{k)  +  B^fp  (*(*))  +  ^(fc)] 
-2^  (i(fc))  Vpixfi))  +  2S$  (x{k))  A Fx{k),  x{k)  G  fi(P,  p). 

Recalling  that  for  two  vectors  a,  b  and  any  positive  number  77, 

(o  4-  b)T(a  +  &)<(!  +  rj)aTa  +  (1  +  l/ri)bTb, 
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we  have 


V($(fc  +  1)) 

<  (1  +  7?)  [(1  +  BAiF)  x{k)  +  BVp  (x(k))]T P  [(A  +  BAXF)  x(k)  +  B9p  ( x{k ))] 

-29}  (: x{k ))  Vp  C x(k ))  +  (*(fc))  AFx(k)  +  (1  +  l/rj)w{k)TETPEw{k) 

__  x(k)  T  (1  +t?)  (A  +  BAXF)T  P  [A  +  BAXF)  _* 

~  9p  ( x(k ))  (1  +  7 i)BrP  (A  +  BAXF)  +  A F  (1  +  t])BtPB  —  21 

+(1  +  l/f])wT(k)ETPEw(k). 


x(k) 

9p  (x(k)) 


where  and  elsewhere,  *  denotes  a  block  in  a  matrix  that  can  be  inferred  by  symmetry. 
By  assumption,  wT(k)w( k)  <  1,  hence, 

wT(k)ETPEw{k)  <  Amax  (ETPE)  :=  X. 


On  di 2(P, p),  xTPx  =  pox  xrPx/p  =  1,  we  can  write 


Amax  {ErPE)  =  A xT(k)Px(k)/P,  E'PE  <  XI. 


It  then  follows  that 
A V(x(k)) 

=  V(x(k  +  1))-V(x(k)) 

-  ■  x{k)  1T  f  {1+V)(A  +  BAxF)tP{A  +  BAxF) 

-  [**(*(*))]  l  (1  +  ti)BtP(A  +  BAxF)+AF  (1  +  t])BtPB  —  27  J 

+(1  +  1/t ])wT{k)ETPEw(k)  -  xT(k)Px{k) 

x(k)  1T  [  (1  +  t?)  (A  +  BAxF)tP  (A  +  BAXF)  _  .  . 

p  (£(*))  J  [  (1  +  r))BTP  (A  +  BAXF)  +AF  (1  +  t?)5tP B  -  21  J  [  9p  (x(k)) 

+(1  +  l/r])XxT (k)Px(k)/p  -  xr(k)Px(k) 

x(k) 

I  |  V  ■  \  _  .  -  '  -  .  '  ..  I  I 


x(k)  ]T  \  (1+t])(A  +  BAxF)tP{A  +  BAxF)  * 

p  (x{k))  J  [  (1  +  7 ?)PTP  (A  +  BAXF)  +AF  (1  +  7?)PtPP  -  21 


x(k) 

[  9p(x(k)) 

x(k) 


'  x(k)  ]T  ’ 

¥ 
O  |V 

1 

o 

x(k) 

.  (*(*))  J 

\  *  r  ' 

0  0  J 

.  %  (*(*))  . 

+  i  „  i  i  v  *»  /»  -j-  :  ii  <rr~rJi.\\  i .  m^dn(p,p). 

Therefore,  AV{x(k))  <  0,  Vx(k)  €  dH(P,  p)  if  there  exists  a  A  G  [o,  such  that 

{A  +  BAxF)tP  {A  +  BAiF)  +  (Yp-ik)P  (A  +  PA'PV PP  + 

PTP  (A  +  BAiF)  +  y^AP  PTPP  -  iV 


<0,  (10) 


and 


EtPE  <  XI. 


(11) 


9 


If  we  introduce  a  new  variable  g  G  (0, 1) ,  let  g  =  —  —■  For  any  fixed  g  and  p,  it  can  be 

verified  that  the  maximum  value  of  A  is  A*  =  p{  1  -  Jg)2,  achieved  at  77  =  ^  -  1.  We  can  vary 
g  from  0  to  1  and  have  the  following  lemma. 


Lemma  3  (Local  stability)  Consider  the  discrete-time  linear  system  with  saturation  (3),  if  there 
exist  a  positive  definite  matrix  P  and  a  diagonal  matrix  Ai  with  0  <  Ai  <  I  and  A  :=  I  —  Ai 
such  that  A  +  BA\F  is  stable,  and  there  exists  scalar  g  G  (0, 1)  such  that 


[  (I  +  5AiF)t  P  (A  +  BAiF)  -gP  (A  +  BA  1F)t  PB  +  JgFT A 
[  BTP  (A  +  BAiF)  +  ^/gAF  BTPB  -  2^gl 

ETPE  <  p(  1  -  Vff)2/, 


<0, 


(12) 

(13) 


S2(P,p)  C  £(Ai.F), 


(14) 


then,  any  ellipsoid  f l(P,p)  —  {x  :  xTPx  <  p}  inside  the  region  C{Ai  F)  is  an  invariant  set. 


3.2  Regional  l2  Gain  Analysis 
We  start  with  a  definition. 

Definition  2  (Regional  l2  gain  [4])  The  system  (8)  is  said  to  have  a  regional  l2  gain  less  than 
or  equal  to  7  >  0  in  $l(P,p)  if,  for  all  w  G  l2,  the  set  Q(P,p)  is  invariant  and, 

A V(x(k))  <  72||u>(fc)||2  -  ||u(fc)||2,  VS(k)  €  Q(P,p).  (15) 


If  the  system  (8)  has  a  regional  l2  gain  in  fi(P,p),  then,  in  the  absence  of  initial  condition, 
(15)  implies  that 

(7 2w'T(k)w(k)  -  uT(k)u(k))  >  0, 

k=0 


or 

INI2  <  7ll®||2- 


Hence,  by  making  7  small,  we  can  reduce  the  energy  of  the  reconstruction  error  signal. 
The  following  lemma  gives  a  sufficient  condition  for  (15)  to  be  true. 


Lemma  4  Consider  the  system  (8).  The  regional  l2  gain  from  w  to  u  is  less  than  or  equal  to 
7  >  0  if  there  exists  a  P  —  PT  >  0  such  that,  in  addition  to  (12),  (13)  and  (14) >  the  following 
inequality  holds, 


(. A  +  BAiF)TP_{A  +  BAjF)  -  P  +  CrC 

T~vnr>  /  a  .  t-4  a  t-i\  ,  K  T~f  T~> 


BrP(A  +  BA1F)  +  A  F 
ETP{A  +  BA^) 


BTPB  -  21 
ETPB 


ETPE  -  7 2 1 


<  0. 


(16) 
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Proof.  First,  we  note  that,  by  Lemma  3,  inequalities  (12),  (13)  and  (14)  imply  that  fi(P,p)  is 
an  invariant  set.  We  next  show  that  (15)  holds.  To  this  end,  consider  the  Lyapunov  function 
candidate 

V  (x)  =  xAPx. 

Recalling  that 

«£(*)[**(*)  "  e  P)* 

we  have 

AV(x (fc))  -  (72|Mfc)||2  -  ||fi(fc)Ha) 

<  A V(x(k))  ~  2 *}(x(k))[*p(x(k))  -  A Fx{k)]  -  (72|Mfc)||2  -  ||«(fc)||2) 

=  x(*)T  [(A  +  BAiF)TP{A  +  BAXF)  -  P]  x(k)  +  2$}  (x(k))  [BTP(A  +  BAiF)  +  A F]  x(k) 
+VTr  (x(k))  ( BTPB  -  2 1)*P  (x(k))  +  2wT (k)ETP(A  +  BAiP)x{k) 

+2wT{k)ETPB^p  (x(k))  +  wT(k)ETPEw(k)  +  xFC^Cx  -  72u>Tu> 

=  xT(k)  [(I  +  BAxF)tP(A  +  BAiF)  -P  +  CPC]  x(k) 

+2*1  (x{k))  [BtP{A  +  BAiF)  +  AF]  x{k)  +  (x(k))  (. BTPB  -  2 1)Vp  (x(k)) 

+2u/T(A :)ETP{A  +  BAxF)x{k)  +  2wT  (k)ETPMp  {x{k))  +  wT(k)  ( ETPE  -  7 2l)  w(k) 

HP  r  x{k) 

=  [x(fc)T  ¥£(*(*))  wr(k)]M  *p(x(k))  ,  *(fc)efi(P,p), 

w(k) 

in  which 

'  (A  +  BA^yPiA  +  BAjF)  -P  +  CTC  *  * 

M BtP(A  +  BA1F)+AF  BtPB-2I  _  _* 

ETP(A  +  BAXF)  ETPB  ETPE  -  7 2I  . 

Clearly,  M  <  0  implies  that 

A V(x(k))  -  (72 |(-u>(A7) ||2  -  ||u(/c)||2)  <  0,  Vx(fc)  €  fl(P, p). 


3.3  Robust  hybrid  filtering  design 

We  now  proceed  to  develop  a  robust  hybrid  filtering  algorithm.  The  goal  of  such  a  robust  hybrid 
filtering  algorithm  is  not  only  to  meet  the  H2  and  #00  criterion  under  linear  operation  environ¬ 
ment,  but  also  to  secure  a  low  regional  l2  gain  under  amplitude  saturation.  By  accommodating 
both  linear /saturated  working  scenarios,  we  will  be  able  to  ensure  that  the  saturation  will  not 
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severely  deteriorate  the  reconstruction  performance,  while  the  response  in  saturation-free  phase 
is  also  acceptable. 

The  robust  hybrid  filtering  problem  can  be  stated  as  follows. 

Problem  1  Given  a  discrete-time  system,  where  the  measured  output  r  is  corrupted  by  satura¬ 
tion  and  noise,  and  u  is  the  signal  to  be  reconstructed, 

x(fc  +  l)  =  Ax(k)  +  Bv(k), 

r(k )  =  sat  (Gx(k))  +  Ew(k), 
u(k )  =  Dx(k). 

For  some  prescribed  scalars  t  >  0  and  p  >  0,  we  would  like  to  design  a  filter 

£(fc  +  l)  =  Afx(k)  +  Bfr{k), 
u(k)  =  C/x(k), 

such  that  the  regional  l2  gain  from  [  vT(k)  wT{k)  ]T  to  the  filtering  error  u{k )  =  u{k)  -  u(k) 
is  minimized,  while  the  H2-norm  and  Hoo-norm  of  transfer  function  T(z)  =  C(zl  -  Al)~1E  are 
less  than  or  equal  to  r  and  p,  respectively. 

Summarizing  Lemma  1  through  Lemma  4,  and  letting  P  =  R  1,  we  can  formulate  the 
synthesis  problem  as  follows. 

min  72 

P=PT>0,p,g,Af,Bf  ,Df 

s.t.  (5),  (6),  (7),  (12),  (13),  (14),  (16), 

P  >  0, 

0  <3  <  1. 

It  is  observed  that  the  above  constraints  are  not  LMIs  with  respect  to  P,Af,Bf  and  Dj.  In 
an  effort  to  transform  the  synthesis  problem  into  an  LMI  constrained  optimization  problem,  we 
need  examine  these  constraints  further. 

First  consider  (5).  Recalling  that  congruence  transformation  does  not  change  positive  (neg¬ 
ative)  definiteness,  we  apply  congruence  transformation  R~l  and  obtain 

{RT1  Al)R{R~1  Al)t  -  R~l  +  (R-'EYR-'EY  <  0- 

Applying  Schur  complement  twice,  we  obtain 


‘  R-1 

RTlAL  R~lE  " 

AIR-1 

R-1  0 

>0; 

_  ETR~1 

o  1 

12 

or 


P  pal 
A\P  P 
ETP  0 


PE  1 


0 

I 


>0. 


(17) 


Next  consider  (6).  We  introduce  an  auxiliary  matrix  N  :=  r2I/q ,  where  q  is  the  number  of 
rows  of  C.  A  sufficient  condition  for 


tr&ce(C RCr)  <  r2 


is 

CRCT  <  N, 

which  by  Schur  complement  is  equivalent  to 

n  1 

>  0. 


N  C 

CT  p 


(18) 


We  temporarily  skip  (7)  and  go  to  (12).  The  left  hand  side  of  inequality  (12)  equals 

+ 


-gP  yfgFr  A 
^/gAF  -2^/gI  J 


(A  +  BA^)* 
BT 


or 


+ 


-gP 

[  VffAF  -2y/gl  J 

By  Schur  complement,  we  arrive  at 


(A  +  BAXF)TP 
BTP 


P  [  A  +  BAiF  B  ], 

P~l  [  P  (A  +  BAiF)  PB ]. 


-gP  yfgFTA  {A  +  BA\F)TP 
yfgAF  -2y/gl  B^P 

[P(A  +  BAxF)  PB  -P 


<0,  0  <  g  <  1. 


As  to  inequality  (13),  it  is  equivalent  to 

p  (1  -  Vs)2  J  -  (ETP)  P-1  {PE)  >  0, 


which  by  Schur  complement  gives 

r  o(i -vef  i  &p 


>0,  p  >  0,0  <  <7  <  1. 


PE  P 

Now  consider  (14).  This  constraint  can  be  translated  to 

P>p(AiF)T(A!F)i,  p>0,Vi, 


(19) 


(20) 


(21) 


where  (AiF)»  is  the  ith  row  of  AiF. 


13 


Finally,  the  left  hand  side  of  constraint  (16)  can  be  written  as 


‘  (I  +  BAiF)t  ' 

'  CrC  -  P 

0  FTA  ] 

Er 

P  [  A  +  BA\F  E  B  ]  + 

0  —7  I  0 

BT 

A  F 

0  -27  J 

By  Schur  complement,  constraint  (16)  is  equivalent  to 


CTC-P 

0 

FT  A 

(A  +  BAiFfP  ‘ 

0 

-72/ 

0 

ETP 

A  F 

0 

-27 

BTP 

P(A  +  BAlF) 

PE 

PB 

-P 

Now  we  are  able  to  reformulate  the  synthesis  problem  as  follows, 


min  72 

P=PT>0,p,g,Af,Bf,Df 

s.t.  (17),  (18),  (7),  (19),  (20),  (21),  (22), 

P>  0, 

0  <g  <  1. 


(22) 


At  this  stage,  we  can  easily  turn  this  problem  into  an  LMIs  constrained  optimization  problem 
by  the  following  technique.  Assume  P  is  of  the  form 

Pss\X  Y] 

Y  Y  J  ’ 

where  X  and  Y  are  positive  definite  and  satisfy  X  >  Y.  Then  define  new  variables 

Qa  =  YAf,Qb  =  YBf. 


By  substituting  the  parameters  of  A,B,D,G,X,Y,QaiQb  Df  into  the  matrix  inequal¬ 
ities  (17),  (18),  (7),  (19)-(22),  and  denoting  72  :=  J2,  we  arrive  at  the  following  LMIs  in 
p,j2,X,Y,Qa,Qb  and  Df  correspondingly, 


’  X  Y  XA  +  QbG  Qa 
Y  Y  YA  +  QbG  Qa 


*  *  X  Y 

*  *  *  Y 

*  *  *  * 

*  *  *  * 


XB  QbE  ' 
YB  QbE 
0  0 
0  0 
I  0 
*  I 


>0, 


‘  N  D  -Df 

*  X  Y 

*  *  Y 


>0, 


(23) 


(24) 
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X 

Y 

0 

0 

XA  +  QbG 
YA  +  QbG 
D 


Y 

Y 
0 
0 

Qa 

Qa 

-Df 


* 

* 

pi 

0 

XB 

YB 

0 


-gx  -gY 

-gY  -gY 

■s/gAG  0 

XA  +  QbkiG  Qa 
|_  YA  +  QbA\G  Qa 


* 

* 

* 

gi 

QbE 

QbE 

0 

* 

* 

-2  y/gl 

Qb 

Qb 


* 

* 

* 

* 

X 
Y 

o 

* 

* 

* 

-X 

-Y 


* 

* 

* 

* 

Y 

Y 
0 


* 

* 

* 

* 

* 

* 

pi  J 


>0. 


* 

* 

* 

-Y 

-Y 


<0, 


(25) 


(26) 


'  P{  1 

~V9? 

I 

* 

* 

* 

0 

P(  1 

-Vs) 

2 1 

* 

* 

>0, 

(27) 

XB 

QbE 

X 

Y 

YB 

QbE 

Y 

Y  _ 

X>p(A1G)J(A1G)i, 

Vi, 

(28) 

-X 

-Y 

* 

* 

* 

* 

* 

* 

-Y 

-Y 

* 

* 

* 

* 

* 

* 

0 

0 

-72 1 

* 

* 

* 

* 

* 

0 

0 

0 

—72 1 

* 

* 

* 

* 

<  0. 

(29) 

AG 

0 

0 

0 

-27 

* 

* 

* 

XA  +  QbAiG 

Qa 

XB 

QbE 

Qb 

-X 

-r 

* 

YA  +  QbAiG 

Qa 

YB 

QbE 

Qb 

-Y 

-Y 

* 

L  D 

-Df 

0 

0 

0 

0 

0 

-j  _ 

Therefore,  the  robust  hybrid  filter  can  be  formulated  into  the  following  LMIs  constrained 
optimization  problem  that  is  readily  solvable  by  the  Matlab  LMI  toolbox. 


s.t.  (23),  (24),  (25),  (26),  (27),  (28),  (29), 

X  =  XT  >Y  =  YT  >0, 

P>  0, 

72  >  0, 

0  <  g  <  1. 

Note  that  constraints  (26)  and  (27)  are  not  linear  with  respect  to  parameter  p,  and  we  must  fix 
g  each  time  until  minimal  72  is  found.  The  parameters  Af  and  B j  of  filter  T  can  be  recovered 
by  Af  =  Y_1Qq  and  Bf  =  Y~xQh,  respectively. 
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3.4  An  Example 
Consider  the  system 


x(fc  +  l)  =  Ax(k)  +  Bv(k), 

r(k)  =  sat  (Gx(k))  +Ew(k), 
u(k)  =  Dx(k), 


with 


'  0  0  0  ]  1  ' 

A  =  10  0  ,£  =  0  ,G  = 

0  1  0  J  0 


-0.0007  0.9462  0.0647 

0.0017  1.2856  0.0017  n  _  r  n  n  ,  l  P  _  r 

0.0647  0.9462  -0.0007  ,D  *•  °  ° 

0.3453  0.3453  0 


We  would  like  to  design  a  filter  of  the  following  form, 


x(k  +  1)  = 

Afi(k )  +  Bfr(k), 

u(k)  = 

Dfx(k). 

By  our  hybrid  design  method, 

we  obtain 

'  0.0959 

-0.0496 

0.0030 

=  0.2605 

-0.1356 

0.0085 

-0.0148 

0.0527 

-0.0125 

'  0.0739  0.0960  -0.0471  -0.6145  ' 

Bf  =  0.1860  0.2413  -0.1266  -1.5899  , 

[  -0.2162  -0.2945  -0.2046  -0.0128  _ 

and 

Df  =  [  -0.0006  -0.0320  -0.9895  ]  . 

By  the  mixed  B[2/H00  method  [6],  we  obtain 

'  -0.0000  -0.0000  -0.0000  -0.0000  ' 

K  =  -0.0335  -0.0434  0.0251  0.2983 

0.2034  0.2773  0.2019  0.0625 


To  evaluate  the  reconstruction  performance,  we  define  the  output  signal  to  noise  ratio  (SNR)  as 
a  relative  measure  of  reconstruction  error, 

Et .u2(k) 

SNR°:=  10Iog1D  Si(„(t)_Vw)2. 
while  the  input  signal  to  noise  ratio  is 


SNR* 


101og10 


Ekw2(k)' 


16 


to 

J 

1 


Figure  3:  Reconstruction  performance  of  the  hybrid  design  and  mixed  H2/  II co  design:  under 
saturation. 

With  amplitude  saturation,  when  the  input  signal  to  noise  ratios  (SNR1)  are  0dB,5dB,  lOdB, 
15dB  and  20dB,  the  reconstruction  SNR  of  our  design  (denoted  by  SNRjj)  and  mixed  II 2/ Hoc 
design  of  [6]  (denoted  by  SNR°M )  are  listed  in  the  the  following  table,  and  illustrated  in  Fig.  3. 


SNR1 

0 

5 

10 

15 

20 

SNR°h 

6.3270 

9.5259 

11.3614 

12.1525 

12.4360 

snr°m 

6.3365 

9.3415 

10.9891 

11.6744 

11.9156 

The  performance  comparison  in  linear  (unsaturated)  case  is  illustrated  in  Fig.  4.  It  is  noteworthy 
that  in  both  cases  our  filter  performs  significantly  better. 

4  Digital  Transmultiplexers 

In  this  section,  we  will  apply  the  hybrid  filter  design  algorithm  to  the  digital  transmultiplexer 
systems.  We  will  first  recall  the  state  space  model  of  digital  transmultiplexers  established  in 
[6,  17],  with  a  slight  modification  to  accommodate  the  amplitude  saturation.  To  design  the 
separating  filter  bank,  a  generalized  dynamic  filter  in  state-space  form  is  proposed  and  obtained 
by  our  hybrid  design  method  via  the  LMI  technique  in  Section  3.  Simulation  will  compare  its 
reconstruction  performance  to  that  in  [6],  and  show  that  our  filter  is  indeed  efficient  to  retain 
reconstruction  performance  under  saturation. 

4.1  State  Space  Model  of  Digital  Transmultiplexer  Systems 

The  block  diagram  of  a  multi-rate  digital  transmultiplexer  system  with  linear  channel  distortion, 
amplitude  saturation  and  measuring  noise  is  shown  in  Fig.  5.  The  digital  transmultiplexer 
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Figure  4:  Reconstruction  performance  of  the  hybrid  design  and  mixed  H^/ £/«>  design:  without 
saturation. 


system  without  saturation  can  be  modeled  as  in  [6,  17].  The  input  signals  to  the  M  band 
transmultiplexer,  uq  ( k ),  u\ ( k ) ,  •  •  •  ,  um—i  (k)  3X6  first  expanded  by  a  factor  of  N ,  then  they  pass 
through  the  M  FIR  combining  filters  Fo(z),  F\(z),---  ,  Fm-i{z)  (synthesis  filter  bank)  to  be 
combined  into  a  single  signal  which  then  is  transmitted  via  a  common  communication  medium 
with  transfer  function  of  C(z).  Define  Gi(z)  =  Fi(z)C{z),  the  overall  transfer  functions  for  M 
channels  are  {Gi(z),  i  =  0, 1,  •  •  •  ,  M  -  1}  with  order  L',  and  L'  is  chosen  as  an  integer  multiple 
of  iV  (if  not  so,  use  zero-padding).  Let  L  =  L'/N,  define  the  state  vector  of  length  ML, 

x{k)  =  [xl{k),xl{k),-  (*)]T, 


with 

Xi(k )  =  [v,i(k),Ui(k  —  1),  •  •  •  ,Ui(k  —  L  +  1)]T,  *  =  0, 1,  •  ■  •  ,M  —  1, 

and  the  input  vector 

v(k)  =  [uo(&  +  1),  ui(k  +  1),-  ,UM-\{k  +  1)]T- 

Let  r(k )  denote  the  measured  output,  and  w(k)  the  additive  noise  including  quantization 
error,  channel  disturbance  and  measurement  noise  at  the  receiver  (for  convenience  we  will  simply 
call  w(k)  the  measurement  noise  later  in  this  paper).  Here  w  is  assumed  to  have  finite  energy 
and  bounded  amplitude,  but  its  statistics  is  not  known.  Now  that  v(k )  is  the  system  driving 
noise  with  unknown  statistics,  according  to  [17]  and  [6],  the  saturation-free  state  space  model 
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of  transmultiplexer  is 


x(k  + 1)  =  Ax(k)  +  Bv(k), 
y(k )  =  Gx(k), 
r(k)  =  y(k)+w(k). 


Note  that  the  (finite  length)  sequence  {&(«),  n  =  0, 1,  1}  denotes  the  impulse  response 

of  the  ith  channel  Gj(z).  In  matrix  D,  ek  stands  for  a  column  vector  of  length  ML  where  the 
Jfcth  element  is  one  but  all  other  elements  are  zero. 

If  we  also  consider  the  saturation  effect  in  the  channel,  then  the  final  model  of  transmulti- 
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Figure  5:  Digital  transmultiplexer  subject  to  saturation  and  additive  noise, 
plexer  is  established  as 

x(k  +  1)  =  Ax(k )  +  Bv(k ), 

y(k)  =  Gx(k ),  (30\ 

r(k)  =  sa,t{y{k)) +w{k), 
u{k)  =  Dx(k). 

At  the  receiver,  what  is  obtained  is  the  distorted  and  contaminated  version  of  combined 
signal  from  which  we  must  design  a  separating  filter  bank  to  recover  the  inputs  up  to  a  constant 
delay,  i.e.,  u0(k  -  d),  ui(k  -  d),  •  •  • ,  uM-i(k  -  d).  In  other  words,  we  would  like  to  estimate 
u{k )  from  received  signal  r(k).  We  use  the  following  generalized  dynamic  filter 

x(k  +  1)  =  Af£(k)  +B/r(k), 
u(k)  =  Df£(k). 


4.2  A  Numerical  Example 

This  four  band  transmultiplexer  example  is  borrowed  from  [6].  The  input  signals  are  generated 
by  letting  a  zero-mean  white  Gaussian  process  pass  through  a  10-th  order  autoregressive  (AR) 
model 

Ar(z)  =1  -  l.lz-1  -  0.23z-2  +  0.633z-3  -  0.129z~4  -  0.1621z~5 

+  8.8948  x  10-2z-6  +  1.6251  x  10_2z"7  -  1.7851  x  10-2z-8 
-  1.3124  x  10“V9  +  7.5725  x  lO'V10. 

The  input  signals  are  expanded  by  a  factor  of  12,  then  go  through  the  length-16  combining  filter 
bank  {Fi(z),i  =  0,1,2, 3}.  The  combined  signal  is  transmitted  via  a  communication  medium 
whose  impulse  response  is  described  by 

C(z )  =  1  +  1.36z-1  +  0.3948z~2  -  0.631z-3  -  0.7495z“4  -  0.3055z-5  +  0.0419z-6. 
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The  frenquency  response  of  C(z)  is  depicted  in  Fig.  7,  and  it  can  be  seen  how  this  channel 
distorted  transmitted  signals  in  magnitude  and  phase.  The  channel/measuring  noise  is  modeled 
by  zero-mean  white  Gaussian  noise.  By  the  modeling  procedure  developed  in  [6],  we  obtain 
matrix  G: 


0.3637 

-2.4848  0.0853 

0.4252 

0.4290 

0.2427 

-0.2430 

-0.0768 

0.6836 

-5.2951  -0.0442 

5.7500 

0.4764 

1.9490 

-0.2929 

0.0393 

0.1542 

-4.8631  0.0247 

3.6600 

0.1633 

0.1059 

-0.0938 

-0.0734 

-1.3389 

-2.6194  -0.0322 

0.7067 

-1.1246 

-1.1791 

0.6688 

0.1423 

-2.8577 

-0.8069  -2.2945 

-0.2236 

-1.1345 

-0.4731 

-0.9064 

0.2820 

-2.7536 

-0.2139  -4.9396 

-0.3266 

2.9017 

0.1951 

1.1991 

0.2389 

0.1305 

-0.2202  -0.9387 

-0.4355 

0.8707 

0.2461 

-0.8508 

-0.0481 

5.2274 

-0.1957  9.0781 

-0.3601 

-4.4889 

0.1216 

0.3316 

-0.2045 

10.0426 

-0.0758  11.6440 

-0.1355 

0.3573 

0.0328 

0.2642 

-0.1032 

11.6369 

-0.0102  0.1275 

-0.0180 

4.0435 

0.0036 

.  -0.5275 

-0.0152 

8.8303 

0  -11.8774 

0 

-0.7888 

0 

0.4027 

0 

3.0940 

0  -9.9863 

0 

-2.8276 

0 

-0.1470 

0 

By  using  the  hybrid  design  method,  we  obtain  the  parameters  Af ,  Bj  and  Dj  of  the  filter,  and 
the  frequency  response  of  the  separating  filters  are  depicted  in  Fig.  6.  Note  that  the  orthogonality 
of  the  filter  bank  is  ruined  due  to  the  channel  distortion  and  amplitude  saturation.  In  particular, 
looking  at  the  frequency  response  of  channel  C(z)  without  saturation  (Fig.  7),  we  observe  that 
the  channel  suppresses  the  high  frequency  components.  As  can  be  seen,  the  separating  filters  of 
the  3rd  and  4th  band  have  higher  gains  than  the  other  two,  which  could  be  interpreted  as  the 
higher  gains  serve  to  compensate  the  suppression  of  the  magnitude. 

To  evaluate  the  reconstruction  performance,  we  define  the  output  signal  to  noise  ratio  (SNR) 
of  the  ith  band  as  a  relative  measure  of  reconstruction  error, 


SNR0  :=  101og10 


VkU^k) 


-±wjumoe k(ui(k) -*&))*' 
while  the  input  signal  to  noise  ratio  of  the  ith  band  is 

cat-ci  ml _ ^ kVi  (&) 


SNR1  :=  101og10 


O' 


When  no  saturation  occurs,  with  input  signal  to  noise  ratio  SNR1  at  the  receiver  equals 
OdB,  5dB,  lOdB,  15dB  and  20dB  respectively,  we  test  the  system  by  obtaining  the  output  signal 
to  noise  ratio  SNR0  at  the  reconstruction  output.  We  list  the  simulation  results  of  the  second 
band  from  the  hybrid  design  scheme,  denoted  as  SNR°H  and  the  results  from  mixed  Ni  / 
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Figure  6:  Frequency  responses  of  the  separating  filter  bank. 


method  denoted  as  SNRIf. 


SNR 1 

0 

5 

10 

15 

20 

SNR°h 

16.5880 

21.5734 

26.5268 

31.3817 

35.9507 

SNR°m 

16.6627 

21.6577 

26.6422 

31.5940 

36.4455 

When  (amplitude)  saturation  takes  place  in  the  process  of  transmission,  i.e., 

r(k)  =  sat  (y(k))  +  w(k), 

we  run  the  system  and  obtain  the  following  results. 


SNR 

0 

5 

10 

15 

20 

SNR°h 

15.9272 

19.8136 

22.4881 

23.8654 

24.4169 

SNR°m 

15.9155 

19.6867 

22.2012 

23.4525 

23.9422 

From  the  simulation  results,  we  notice  that  in  linear  case,  our  design  has  slightly  lower  output 
SNR  (0.08-0. 5dB)  compared  to  the  mixed  H2/H00  approach,  but  when  amplitude  saturation 
is  present  in  the  channel,  our  design  outperforms  the  mixed  H2/H <*,  by  as  much  as  0.47dB 
(11.4%).  Our  design  method  demonstrates  a  better  reconstruction  property  in  saturated  case 
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at  the  slight  cost  of  linear  performance.  However  it  is  worth  noticing  that,  in  linear  case  when 
output  SNR  is  already  high,  a  degradation  of  0.1-0.5dB  is  often  acceptable,  while  in  saturated 
operation,  an  improvement  of  0.1-0. 5dB  will  be  critical  to  the  overall  system  performance. 

5  Conclusions 

In  this  paper,  we  have  discussed  the  design  of  separating  filter  bank  of  digital  transmultiplexer 
systems  with  consideration  of  amplitude  saturation  and  proposed  a  so-called  hybrid  filter  design 
method.  The  hybrid  method  takes  advantage  of  linear  filtering  and  nonlinear  regional  I2  gain 
filtering  in  order  to  preserve  the  reconstruction  performance  when  saturation  takes  place.  This 
problem  is  formulated  into  an  optimization  problem  with  LMI  constraints.  Simulation  results 
show  the  robustness  of  our  design  in  the  presence  of  saturation. 
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Abstract 

Takagi-Sugeno  (TS)  fuzzy  models  can  provide  an  effective  representation  of  complex  nonlinear 
systems  in  terms  of  fuzzy  sets  and  fuzzy  reasoning  applied  to  a  set  of  linear  input-output  submodels. 
In  this  paper,  the  TS  fuzzy  modeling  approach  is  utilized  to  carry  out  the  stability  analysis  and 
control  design  for  nonlinear  systems  with  actuator  saturation.  The  TS  fuzzy  representation  of  a 
nonlinear  system  subject  to  actuator  saturation  is  presented.  In  our  TS  fuzzy  representation,  the 
modeling  error  is  also  captured  by  norm-bounded  uncertainties.  A  set  invariance  condition  for  the 
system  in  the  TS  fuzzy  representation  is  first  established.  Based  on  this  set  invariance  condition, 
the  problem  of  estimating  the  domain  of  attraction  of  a  TS  fuzzy  system  under  a  constant  state 
feedback  law  is  formulated  and  solved  as  an  LMI  optimization  problem.  By  viewing  the  state 
feedback  gain  as  an  extra  free  parameter  in  the  LMI  optimization  problem,  we  arrive  at  a  method 
for  designing  state  feedback  gain  that  maximizes  the  domain  of  attraction.  A  fuzzy  scheduling 
control  design  method  is  also  introduced  to  further  enlarge  the  domain  of  attraction.  An  inverted 
pendulum  is  used  to  show  the  effectiveness  of  the  proposed  fuzzy  controller. 

Key  Words:  nonlinear  systems,  Fuzzy  control,  uncertainty,  linear  matrix  inequality  (LMI),  robust 
control,  actuator  saturation. 
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1  Introduction 

Fuzzy  logic  control  [24]  is  an  effective  approach  to  designing  nonlinear  control  systems,  especially  in  the 
absence  of  complete  knowledge  of  the  plant.  It  has  found  successful  applications  not  only  in  consumer 
products  but  also  in  industrial  processes  (see,  e.g.,  [6,  12,  15]  and  the  references  therein).  Recently, 
a  conceptually  simple  nonlocal  approach  to  fuzzy  control  design  was  proposed  for  nonlinear  systems 
[17,  18,  22,  21].  The  procedure  is  as  follows:  First  the  nonlinear  plant  is  represented  by  a  so-called 
Takagi-Sugeno  (TS)  type  fuzzy  model.  In  this  type  of  fuzzy  model,  local  dynamics  in  different  state 
space  regions  are  represented  by  linear  models.  The  overall  model  of  the  system  is  obtained  by  fuzzy 
“blending”  of  these  local  models.  The  control  design  is  carried  out  based  on  the  fuzzy  model  by  the 
so-called  parallel  distributed  compensation  (PDC)  scheme  [18,  22].  For  each  local  linear  model,  a 
linear  feedback  control  is  designed.  The  resulting  overall  controller,  which  is  nonlinear  in  general,  is 
again,  a  fuzzy  blending  of  those  individual  linear  controllers. 

Actuator  saturation  can  severely  degrade  the  closed-loop  system  performance  and  sometimes  even 
make  the  otherwise  stable  closed- loop  system  unstable.  The  analysis  and  synthesis  of  control  systems 
with  actuator  saturation  nonlinearities  have  been  receiving  increasing  attention  recently  (see,  e.g., 
[8,  14]  and  the  references  therein).  Very  often,  actuator  saturation  is  dealt  with  by  either  designing 
low  gain  control  laws  that,  for  a  given  bound  on  the  initial  conditions,  avoid  the  saturation  limits, 
or  estimating  the  domain  of  attraction  in  the  presence  of  actuator  saturation.  In  this  paper,  we  will 
utilize  the  TS  fuzzy  modeling  approach  to  analyze  the  domain  of  attraction  of  nonlinear  systems  with 
actuator  saturation.  In  our  analysis  procedure,  a  given  nonlinear  system  with  actuator  saturation  is 
first  represented  by  a  set  of  TS  models  with  input  saturation.  The  system  dynamics  is  captured  by 
a  set  of  fuzzy  implications  which  characterize  local  relations  in  the  state  space.  The  main  feature  of 
the  TS  fuzzy  model  is  to  express  the  local  dynamics  of  each  fuzzy  rule  by  a  Unear  state  space  system 
model  with  input  saturation.  The  overall  fuzzy  model  of  the  system  is  obtained  by  fuzzy  “blending 
of  those  individual  models  with  input  saturation.  In  [20],  actuator  saturation  constraint  was  dealt 
with  by  designing  low  gain  control  laws  that,  for  a  given  bound  on  the  initial  conditions,  avoid  the 
saturation  limits.  It  is  known  that  low-gain  controllers  that  avoid  saturation  wiU  often  result  in  low 
levels  of  performance.  The  domain  of  attraction  was  not  discussed  either. 

This  paper  takes  the  fuzzy  control  approach  to  dealing  with  stability  analysis  and  control  design 
of  nonhnear  systems  with  actuator  saturation.  A  TS  fuzzy  model  with  input  saturation  and  norm- 
bounded  uncertainties  is  proposed  to  represent  the  original  nonlinear  systems  with  actuator  saturation. 
A  set  invariance  condition  for  the  system  in  the  TS  fuzzy  representation  is  first  established.  Based  on 
this  set  invariance  condition,  the  problem  of  estimating  the  domain  of  attraction  of  a  TS  fuzzy  system 
under  a  constant  state  feedback  law  is  formulated  and  solved  as  an  LMI  optimization  problem.  By 
viewing  the  state  feedback  gain  as  an  extra  free  parameter  in  the  LMI  optimization  problem,  we  arrive 
at  a  method  for  designing  state  feedback  gain  that  maximizes  the  domain  of  attraction. 

The  paper  is  organized  as  follows.  In  Section  2,  the  TS  fuzzy  model  with  input  saturation  is 
first  introduced  and  a  set  invariance  condition  is  derived  using  Lyapunov  function  based  approach.  In 
Section  3,  robust  stability  condition  is  given  for  the  TS  fuzzy  model  with  input  saturation  and  modeling 
uncertainties.  In  Section  4,  a  robust  state  feedback  fuzzy  scheduling  control  law  for  the  uncertain 
fuzzy  systems  with  actuator  saturation  is  proposed  based  on  the  parallel  distributed  compensation.  In 
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Section  5,  an  inverted  pendulum  subject  to  actuator  saturation  is  used  to  demonstrate  the  effectiveness 
of  our  analysis  and  design  method.  The  paper  is  concluded  in  Section  6. 

Notations:  The  following  notations  will  be  used  throughout  the  paper.  R  denotes  the  set  of  real 
numbers,  R+  the  set  of  nonnegative  real  numbers,  Rm  the  m  dimensional  Euclidean  space,  and  R 
the  set  of  all  n  x  m  real  matrices.  In  the  sequel,  if  not  explicitly  stated,  matrices  are  assumed  to  have 
compatible  dimensions.  The  notation  M  >  (>,  <,  <)0  is  used  to  denote  a  symmetric  positive  definite 
(positive  semidefinite,  negative  definite,  negative  semidefinite,  respectively)  matrix. 

2  Problem  Statement  and  Preliminaries 

2.1  Problem  Statement 

Consider  a  nonlinear  system  described  by 

x(t)  =  f{x{t),v{t)),  (1) 

where  x  G  W1 .  v  G  Rm  and  /  is  sufficiently  smooth  in  x  and  affine  in  v.  The  control  input  v  is  subject 
to  actuator  saturation.  Our  goal  is  to  design  a  state  feedback  controller 

v(t)  =  n(t)  =  F(x(t)),  (2) 

such  that  the  origin  of  the  closed-loop  system  is  asymptotically  stable  with  a  domain  of  attraction  as 
large  as  possible,  where  the  function  cr  :  Rm  -»  Km  is  the  standard  saturation  function  of  appropriate 
dimensions  defined  as  follows 

a(u)  =  [  cr(ui)  a(«2)  •••  cr(um)  ]  , 

where  a(ui)  =  sign(uf)  min{l,  K|}.  Here  we  have  slightly  abused  the  notation  by  using  <r  to  denote 
both  the  scalar  valued  and  the  vector  valued  saturation  functions.  Also  note  that  it  is  without  loss  of 
generality  to  assume  unity  saturation  level.  The  non-unity  saturation  level  can  be  absorbed  into  the 
input  by  applying  the  following  substitution 

v  =  vU,  u  =  U~lu , 

where  U  =  diag (umax,i),  and  is  the  saturation  amplitude  of  the  i- th  input. 

We  will  develop  a  simplified  model  for  which  control  design  is  easier.  Such  a  simplified  model  is 
labeled  as  the  design  model.  In  many  situations,  there  may  be  human  experts  who  can  provide  a 
linguistic  description  of  the  system  in  terms  of  IF-THEN  rules.  For  example,  Takagi  and  Sugeno  [17] 
proposed  an  approach  to  modeling  the  nonlinear  process.  This  method  is  further  developed  by  Sugeno 
and  Kang  [16].  This  type  of  models  are.  referred  as  Takagi-Sugeno  (TS)  or  Takagi-Sugeno-Kang  (TSK) 
fuzzy  models  [19,  2,  21]. 

The  fuzzy  model  is  described  by  fuzzy  IF-THEN  rules,  which  represent  local  linear  input-output 
relations  of  a  nonlinear  system.  The  ith  rules  of  the  fuzzy  models  are  of  the  following  form 

Plant  Rule  i:  IF  z\  (t)  is  Mu  and  •  •  •  and  zg(t)  is  Miq  THEN 
x(t)  =  Aix(t)  +  Biv(t),  i  =  1,2, •  •  •  ,r, 
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where  Mij  is  the  fuzzy  set  and  r  is  the  number  of  IF-THEN  rules  and  zx(t), z2{t),  •  •  • ,  zq(t)  are  the 
premise  variables.  It  is  assumed  in  this  paper  that  the  premise  variables  do  not  explicitly  depend  on 
the  input  variables  v.  Then,  given  a  pair  (s(t) ,«(*)),  the  resulting  fuzzy  system  model  is  inferred  as 
the  weighted  average  of  the  local  models  and  has  the  form 

x(t)  =  A(p(t))x(t)  +  B(p{t))a(u(t)),  (4) 


where 


T  ' 

A(p[t))  =  ^p»( t)Ai,  B(p{t))  =  y^Pt(t)^t) 


i=l 

r 

Pi(z{t))  =  Wj{z(t))/ y ^Wj{z(t)), 

3= 1 
V 

Wi(z(t))  =  n  Mijizjit)), 

3=1 


i= 1 


and  where  Mij{zj(t))  is  the  grade  of  membership  of  Zj(t)  in  Mij.  In  this  paper,  we  assume  that  all 
membership  functions  are  continuous  and  piecewise  continuously  differentiable.  It  is  easy  to  find  that 
the  time-varying  parameter  vector  p(t)  belongs  to  a  convex  polytope  B,  where 


V  :=  \  p  G  Rr  :  =  1,  0  <  Pj{t)  <  1 


(5) 


i=i 


Therefore,  when  Pi(t )  =  1  and  Pj{t)  =  0  for  i,j  €  [1,  r],j  ±  i,  the  fuzzy  model  (4)  reduces  to  its  i-th 
linear  time-invariant  “local”  model,  i.e.,  (. A(p ),  B(p))  =  (Ai}  Bt).  It  is  clear  that  as  p  varies  inside  the 
polytope  V ,  the  system  matrices  of  (4)  vary  inside  a  corresponding  polytope  O  whose  vertices  consist 

of  r  local  system  matrices 


[A(p(t)),  B(p(t ))]  €  ft  =  co{(Aj,  Bi),  i  6  [l,r]}  , 


(6) 


where  co  denotes  the  convex  hull. 

Based  on  the  parallel  distributed  compensation  (PDC)  [18,  22],  we  consider  the  following  fuzzy 
control  law  for  the  fuzzy  model  (4) 

Control  Rule  i :  IF  zx(t)  is  Mu  and  •  •  •  and  Zg(i)  is  Ml(l  THEN  „  ^ 

u(t)  =  Fix(t),  i  =  1)  2,  •  •  • ,  t. 


The  overall  state  feedback  fuzzy  control  law  is  represented  by 


“(*)  = 


ELi  Wi(z(t))Fjx{t) 


i=l 


(8) 


Because  the  fuzzy  models  (4)  are  subject  to  input  saturation,  in  general,  global  stabilizing  con¬ 
trollers  do  not  exist.  The  aim  of  this  paper  is  to  design  r  local  linear  state  feedback  law  (7)  or  a 
time- varying  parameter-dependent  linear  state  feedback  law  (8)  such  that  the  origin  of  the  closed-loop 
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system  with  actuator  saturation  is  asymptotically  stable  in  a  region  as  large  as  possible.  For  simplicity, 
we  will  first  consider  the  following  linear  feedback  control  law 

u(t)  =  Fx(t).  (9) 

This  control  law  can  also  be  obtained  by  setting  Fi  =  F  in  (7).  Control  law  (9)  is  a  constant 
feedback  law,  while  (8)  is  a  time- varying  feedback  law.  Control  law  (8)  is  the  so-called  fuzzy  scheduling 
controller. 

2.2  Set  Invariance  Analysis  for  Fuzzy  Systems 

Let  fi  be  the  *-th  row  of  the  matrix  F.  We  define  the  symmetric  polyhedron 

C(F)  =  {x  €  Rn  :  |/<a:|  <  1,  i  =  l,2,--,ro}. 

If  the  control  u  does  not  saturate  for  all  i  =  1,2,  —  ,  rn,  that  is  a:  €  £{F) ,  then  the  system  (4)  under 
the  control  (9)  admits  the  following  linear  representation 

x(t)  =  ( A(p(t ))  +  B(p(t))F)x(t).  (10) 

Let  P  £  Rnxn  be  a  positive-definite  matrix  and  define  V  =  xTPx.  For  a  positive  number  p,  denote 
the  ellipsoid 

fi(P,  p)  =  {x  £  Mn  :  xTPx  <  p} . 

An  ellipsoid  is  said  to  be  contractively  invariant  if 

V  =  2 xrPf(x,v)  <0,  Vs  e  ft(P,p)\{0}. 

Thus,  if  an  ellipsoid  is  contractively  invariant,  it  is  inside  the  domain  of  attraction.  An  ellipsoid  £1{P,  p) 
is  inside  C(F)  if  and  only  if 

MP/pr'fiZ  1>  i  = 

Let  V  be  the  set  ofmxm  diagonal  matrices  whose  diagonal  elements  are  either  1  or  0.  For  example, 


There  are  2m  elements  in  V.  Suppose  that  each  element  of  V  is  labeled  as  E{ ,  i  1, 2,  •  •  • ,  2  ,  and 
denote  Ef  —  I  -  E{.  Clearly,  E~  is  also  an  element  of  V  if  Ei  e  V. 

Lemma  1  [8]  Let  F,  H  £  Kmxn  be  given.  For  x  eP ,  if  x  £  C(H),  then 

a(Fx)  £  co  {EiFx  +  E~Hx  :  i  £  [1, 2m]}  . 

Consequently,  er(Fx)  can  be  rewritten  as 

2m 

<j{Fx)^Yjr]i{EiF  +  E-H)x, 
i=l 

where  0  <  <  1,  %  =  1- 
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Lemma  2  [4]  Suppose  that  matrices  M,  £  Rmxn,i  =  1,2,--- ,r,  and  a  positive  semi-definite  matrix 
P  £  Mm x  171  are  given.  If  pi  =  1  and  0  <  pi  <  1,  then 

(£>»*)  p  (e^)  s  E?<<™<-  (u) 


For  the  fuzzy  system  subject  to  actuator  saturation  (4)  and  a  given  linear  control  law  (9),  we  have 
the  following  set  invariance  condition. 

Theorem  3  For  a  given  fuzzy  system  (4)  and  a  given  state  feedback  control  matrix  F,  the  ellipsoid 
£l(P,p)  is  a  contractively  invariant  set  of  the  closed-loop  system  under  linear  state  feedback  control  law 
(9)  if  there  exists  a  matrix  H  €  Rmxn  such  that  the  following  matrix  inequalities  hold 

(Ai  +  Bi(EjF  +  ErH)Y  P  +  P  (Ai  +  B^EjF  +  EJ PT))  <0,  i  6  [1,  r],  j  €  [1, 2m],  (12) 

and  £l{P,p)  C  C{H).  Consequently,  the  closed-loop  system  is  asymptotically  stable  at  the  origin  with 
£l(P,p)  contained  in  the  domain  of  attraction. 

Proof.  Choose  a  Lyapunov  function 

V(x  (<))  =  xT(t)Px(t). 


Then, 

F(x)  =  [A(p)z(f)  +  B{p)o{Fx(t))]T  Px(t)  +  xT(t)P  [A(p)x(t)  +  B(p)o(Fx(t))) 
By  Lemma  1,  we  have 

r  r  2m 

I  E ^ 


T 


y(rr)  =  rT(i) 
xT(t)P 

r  2m 


i=l 


i=l  i=l 
r  2m 


+ Y2piBi  Y2  VjiEjF + ■ff) 

i=l  j=l 


i=l 


Px(t)  + 
x(t) 


=  [(Ai  +  Bi(P,F  +  P"P))TP  +  p  (Ai  +  Pi(PjP  +  Ei  #))]  x{t) 

2=1  j= 1 

for  all  x  €  C(H).  By  (12),  we  have 

V{x)  <0,  Vz  £  fi(P,7)\{0}  C  C{H). 


Thus,  if  x^Px0  <  p,  then  xT(t)Px(t)  <  p  for  t  >  0,  i.e.,  ft(P,p)  is  a  contractively  invariant  set.  This 
also  implies  that  the  closed-loop  system  (4)  under  state  feedback  (9)  is  asymptotically  stable  at  the 
origin  with  fi(P,  p)  contained  in  the  domain  of  attraction.  ■ 

Remark  1  Theorem  3  gives  a  condition  for  the  region  Fl{P,  p)  to  be  inside  the  domain  of  attraction 
for  the  closed-loop  system  (4)  under  a  linear  constant  feedback  control  law  (9).  For  the  special  case 
of  r  —  1,  Theorem  3  recovers  the  set  invariance  condition  for  linear  time-invariant  systems  subject  to 
actuator  saturation  [8]. 
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With  all  the  ellipsoids  satisfying  the  set  invariance  condition  of  Theorem  3,  we  may  choose  the 
“largest”  one  to  obtain  the  least  conservative  estimate  of  the  domain  of  attraction.  As  in  [8],  we 
will  measure  the  largeness  of  the  ellipsoids  with  respect  to  a  shape  reference  set.  Let  Xr  C  K"  be  a 
prescribed  bounded  convex  set  containing  origin.  For  a  set  S  C  R71  which  contains  origin,  define 

<2r05)  :=  sup{a  >  0  :  oiXr  C  <?}. 

Obviously,  if  or(S)  >  1,  then  Xr  C  S.  Two  typical  types  of  Xr  are  the  ellipsoid 

4  =  {ieK'1:  xTRx  <  1},  R  >  0,  (13) 


and  the  polyhedron 

XR  =  cofzo^cb"-  >*o}>  (14) 

where  xj,  '  * '  ■>  4  3X6  a  Pnon  given  points  in  Mn . 

With  the  above  reference  sets,  we  can  choose  an  Cl(P,  p)  from  all  that  satisfy  the  condition  such 
that  the  quantity  cxr(CI(P,p ))  is  maximized.  This  problem  can  be  formulated  into  the  following 
optimization  problem: 

min  a,  (15) 

p>o,n 

s.t.  a)  aXRCCt(P,p), 

b )  inequalities  (12),  Vi  6  [1,  r],  j  £  [1, 2771], 

c)  \hix\  <  1,  \fx  G  £l(P,p),  i  =  [l,m], 


where  hi  denotes  the  i-th  row  of  H. 

In  what  follows,  we  will  show  that  the  optimization  problem  (15)  can  be  solved  as  an  LMI  opti¬ 
mization  problem. 

In  the  case  that  the  shape  reference  set  XR  is  given  by  (14),  Constraint  a)  is  equivalent  to 

*-2  (4V 


a2(xl0)TPxo  <  p 


4  (P/P) 


-l 


>0,  *  =  M- 


In  the  case  that  Xr  is  given  by  (13),  Constraint  a)  is  equivalent  to 


a 


—2 


R>P/p  <s=^  R-1  <  a~2(P/p) 


\-l 


Let 


Q.=  (P/p)-\  Z  =  HQ,y  =  a-2. 
Then,  (16)  and  (17)  can  be  written  as  the  following  LMIs 

>0,  t  =  [l,Z], 


7  (4)T 


L  4  Q 


and 


(16) 


(17) 


(18) 

(19) 


R  1  <iQ, 

respectively.  Also,  Constraint  b )  is  equivalent  to 

(AiQ  +  Bi(EjFQ  +  E-Z)^  +  (MQ  +  Bi(EjFQ  +  EJZ ))  <  0,  Vi  €  [1,  r],  Vj  €  [1, 2m].  (20) 
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Constraint  c)  is  equivalent  to 


hi 


1  hiQ 

QhJ  Q 


>0, 


Vi  €  [1  ,m]. 


Also  let  the  i-th  row  of  Z  be  zi5  i.e.,  z*  =  hiQ.  The  optimization  problem  (15)  can  then  be  reduced 
to  the  following  one  with  LMI  constraints, 


mm  7, 
Q>0,Z 


s.t.  a)  LMI  (18)  or  (19), 
b)  LMI  (20), 


c) 


z 7 
L  Zt 


Zi 

Q 


>  0,  Vie[l,m]. 


(21) 


If  we  would  like  to  design  a  control  law  u  —  Fx  such  that  the  domain  of  attraction  of  the  closed-loop 
system  is  as  large  as  possible,  we  only  need  to  replace  Y  =  FQ  in  (20).  With  the  solution  (Q,  Y,  Z ), 
the  state  feedback  control  matrix  F  such  that  the  origin  of  the  system  (4)  is  stabilized  with  a  domain 
of  attraction  as  large  as  possible  with  respect  to  a  given  shape  reference  XR  can  be  solved  by 


F  =  YQ-\ 


In  optimization  problem  (21),  the  amplitude  of  control  law  (9)  is  not  constrained,  i.e.,  there  is  no 
control  amplitude  constraint  on  the  control  law.  In  [9],  the  authors  proved  that  this  controller  design 
method  is  less  conservative  than  the  approaches  based  on  circle  criterion  and  Popov  criterion  [7].  On 
the  other  hand,  to  avoid  the  controller  gain  being  too  large,  we  may  constrain  it  to  be  bounded  by 
fj,0  >  1,  i.e.,  |/tx|  <  Hq,  which  is  equivalent  to  the  following  LMIs 


Mo  Vi 

Vi  Q 


>0,  Vt6[l,m], 


where  iji  denotes  i-th  row  of  Y. 

If  we  require  Y  =  Z,  then  we  can  recover  the  design  algorithm  which  constrains  the  control  law  to 
be  unsaturated  [1,  20].  The  unsaturated  control  algorithm  can  be  described  as: 


s.t. 


Q>0,Y 

a)  LMI  (18)  or  (19), 

b)  ( AiQ  +  BiYf  +  (AiQ  +  BiY)  <  0, 


>  0,  ViG[l,mj. 


Vi  €  [l,r], 


(22) 


Note  that  the  constraints  in  (22)  imply  that  Q(<2-1,1)  C  C{F)  and  hence  the  control  u  =  Fx  will 
never  reach  saturation  limits.  This  will  lead  to  a  very  conservative  control  law.  In  (21),  we  permit  the 
control  to  be  saturated  and  hence  our  algorithm  will  result  in  a  larger  domain  of  attraction.  It  is  also 
known  that  low-gain  controllers  that  avoid  saturation  will  often  result  in  low  levels  of  performance 

[14]. 
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3  Robust  Stability  of  Fuzzy  Systems  with  Uncertainty 

In  the  previous  section,  we  consider  the  stability  of  the  fuzzy  system  (4)  rather  than  the  original 
nonlinear  system  (1).  It  is  an  obvious  fact  that  the  closed-loop  stability  of  fuzzy  system  (4)  cannot 
guarantee  that  of  nonlinear  system  (1).  As  discussed  in  [3],  we  can  present  a  fuzzy  model  with  norm- 
bounded  uncertainty  to  analyze  the  stability  of  the  original  nonlinear  system  (1).  A  TS  fuzzy  model 
with  uncertainty  is  composed  of  r  plant  rules  that  can  be  represented  as  [25,  11,  13], 

Plant  Rule  i :  IF  zx(t)  is  Ma  and  •  •  •  and  zq(t)  is  Miq  THEN  ^3) 

x(t)  =  Aix(t)  +  BMt),  i  =  1,2,  •  •  • ,  r, 

where  Au  and  B{  are  real-valued  time-varying  matrices  of  appropriate  dimensions.  Fuzzy  model  (23) 
is  an  extension  of  local  fuzzy  model  (3).  We  assume  that  the  time- varying  uncertainties  enter  the 
system  matrices  in  the  following  manner: 

Ai(t)  =  Ai  +  AAi(t),  Bi(t)  =  Bi  +  ABi(t),  (24) 

where  A{  and  Bi  axe  some  constant  matrices  of  compatible  dimensions  and  AAj(t)  and  Af?j(t)  are  real¬ 
valued  matrix  functions  of  compatible  dimensions  representing  time- varying  parameter  uncertainties. 
Such  uncertainties  arise  in  the  fuzzy  representation  (3)  of  the  original  nonlinear  system  (1).  The 
uncertainties  are  assumed  to  be  norm-bounded  and  be  given  by 

[  A Mt)  A Bi(t)  ]  =  [  Nu  N2i  ]  ,  (25) 

where  Mi,  Nxi  and  N2i  are  known  constant  matrices  with  compatible  dimensions  and  @i(t)  G 
Kn/i<  xnf2i  are  unknown  nonlinear  time-varying  matrix  functions  satisfying 

<  i.  (26) 

It  is  assumed  that  the  elements  of  0j(t)  are  Lebesgue  measurable.  This  type  of  uncertainty  is  an 
effective  representation  of  some  nonlinear  uncertainties  (see  [5, 10,  23]  and  the  references  therein).  By 
including  these  uncertainties,  the  fuzzy  model  (23)  is  expected  to  better  represent  the  original  system 

(1). 

Now,  given  a  pair  of  (x,v)}  the  final  fuzzy  system  is  inferred  as  follows: 

x(t)  =  A(p(t))x(t)  +  B(p(t))v(t)  (27) 

=  (A(p(f))  +  A  A(p,t))x(t)  +  (B(p(t))  +  A  B(p,t))v(t),  (28) 


where 


A(p)  = 

i=zl  1 

r  r  ^ 

AA(p,t)  =  AB{p,t)  =  y^2piMiQi(t)N2i: 


i=l 


2=1 


and  Af  :=  AAx+ABv  represents  the  difference  between  (4)  and  (1).  By  suitably  selecting  Mj,  Nu  and 
JV2i,  we  can  make  the  original  nonlinear  system  (1)  completely  included  in  the  differential  inclusions 
system  (27)  [1,  11,  3]. 
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Theorem  4  For  a  given  uncertain  fuzzy  system  (27)  and  a  given  state  feedback  control  matrix  F ,  the 
ellipsoid  p)  is  a  contractively  invariant  set  of  the  closed-loop  system  under  linear  state  feedback 
control  law  (9)  if  there  exist  matrices  H  E  Rmxn  and  X{  >  0  such  that 


P  ( Ai  +  B^F  +  EJH))  +  (*)T  +  PMiXiMfP  (*)T 


Nu  +  N2i{EjF  +  EJ  H) 


<0,  i  G  [l,r],  j  €  [1,2" 


(29) 


and  £l(P,p)  C  C{H),  where  *'s  represent  blocks  that  are  readily  inferred  by  symmetry. 


Proof.  Choose  a  Lyapunov  function 


V(x)  =  xT(t)Px(t). 


Then, 


V(x)  =  [i(p)rr(t)  +  B(p)a(Fx{t))Y  Px{t)  +  xT{t)P  [A(p)x{t)  +  B(p)a(Fx{t))\  . 
By  Lemma  1,  we  have  for  all  x  £  jC(H), 


2m 


i=l 


V[x)  =  XT(t) 

+xT(t)P 


y 2 Pi  (  Ai  +  Bj'y'jrjj{EjF  +  Ej  H) 
i= i 


Px{t) 
x{t) 


[Ai  +  Bi  Y,  VjiEjF  +  EJ  H) 

i=l  \  J 

T  2m 

J2]Tpir/jXT(t)  [(Ai  +  BjEjF  +  EJH)Y  P  +  P  (ii  +  &i{EjF  +  EJ  if))]  x(t) 

i=  1  j=l 
r  2m 

£]rmjxT(t)  [(Ai  +  BAEiF  +  EJH))T p  +  p(Ai  +  BAZjP  +  E7 H)) 


i-1  j= 1 
+ 


(n1{  +  N2i(EjF  +  EJH)Y  Qj{t)MjP  +  PMiQJt)  (nu  +  N2i{EjF  +  Ej  #))]  x{t) 

T  2m 

<  [(^  +  BiiEjF  +  EJH)Y  p  +  p  (Ai  +  Bi(EjF  +  EJ  JET)) 


+PMiXiMjP  +  (Nu  +  N2i(EjF  +  EJH)Y XJl  (nu  +  N2i{EjF  +  Ej  #))]  x(t). 

By  (29),  we  have 

V‘(x)<0,  Vx6fl(P,  7)\{0}- 

Thus,  ft(P,p)  is  a  contractively  invariant  set.  This  also  implies  that  the  closed-loop  system  (27) 
under  state  feedback  (9)  is  asymptotically  stable  at  the  origin  with  Q(P,p)  contained  in  the  domain 

of  attraction.  ® 

It  is  easy  to  see  that  matrix  inequality  (29)  can  be  transformed  to  the  following  LMIs 


(AiQ  +  Bi(EjY  +  EJZ))  +  (*)T  +  MiXiMj  (*)’ 
NnQ  +  N2i{EjY  +  EJ  Z)  X{ 


<0,  «€[l,r],i€[l)2m]>  (30) 
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As  in  Section  2.2,  we  can  formulate  the  following  LMI  optimization  to  maximize  the  domain  of 
attraction  of  the  closed-loop  system: 

min  7,  (31) 

Q>0,Xi,Y,Z 

s.t.  a)  LMI  (18)  or  (19), 

b)  LMI  (30), 

c)  ^  ^  ^°>  Vi€[l,»4 

4  Robust  Fuzzy  Scheduling  Control  Law  Design 

As  shown  in  Section  2,  the  approach  to  fuzzy  scheduling  involves  the  design  of  several  LTI  controllers 
for  a  parameterized  family  of  LTI  fuzzy  models.  The  resulting  controller  (8)  is  the  interpolation  of 
these  gains.  Note  that  F  in  (9)  is  a  constant  matrix,  while  the  control  gain  in  (8)  is  a  time-varying 
matrix  function  of  time-varying  membership  function  z(t) .  It  is  reasonable  to  expect  that  this  kind  of 
control  laws  can  result  in  a  larger  domain  of  attraction  and  better  performance. 

With  control  law  (8),  the  closed- loop  system  can  be  rewritten  as 

x(t)  =  ^pi(Aj  +  A Ai)x(t)  +  ^ Pi(Bi  +  A Bi)a  ^Fx(t)J  , 

t=l  i= i 

where  T 

F  =  Y^Pj(z(t))Fj. 
j= i 

By  Lemma  1,  we  have  that  for  any  matrix  H  of  the  same  dimensions  of  F  such  that  x  €  C(H), 

r  r  2771 

x(t )  =  (A{  +  AAi)x(t)  +  (Bi  +  ABi)  jC  rjs(t)(EsF  -t-  E~ H)x(t) 

i=l  L  s=l 

r  2m 

=  ^2  [(-^i  +  AAj)  +  (Bi  +  ABi)(EsF  +  E~ J?)j  x(t), 

t=l  s=l 

where  0  <  rjs(t)  <  1,  V,(*)  =  b  for  all  s  =  1, 2,  •  •  • , 2m.  If  we  let 

r 

H  = 

2 771  r  r 

i(t)  TlsPiPjAs,ijx(t),  (32) 

5=1  i=l  j= 1 

As,ij  :=  (Ai  +  A Ai)  +  (Bi  +  A Bi)(E,Fj  +  E~Hj),  s  6  [1, 2m],  i,j  €  [l,r]. 


then 


where 
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Remark  2  It  is  easy  to  verify  that  the  closed-loop  system  described  by  (32)  can  be  further  simplified 
if  the  subsystem  (23)  possesses  a  common  input  matrix  B,  namely  Bi  =  B  for  all  i.  In  this  case,  the 
closed-loop  system  can  be  simplified  as 


2m  r 

x(t)  =  ((^i  +  AAi)  +  (B  +  AB){EsFi  +  EjHi))  x{t). 

S—l  1=1 

Theorem  5  For  a  given  uncertain  fuzzy  system  (27),  suppose  that  the  local  state  feedback  control 
matrices  Fj,  j  =  1,2,---  ,r,  are  given.  The  ellipsoid  0.(P,p)  is  a  contractively  invariant  set  of  the 
closed-loop  system  under  the  fuzzy  scheduling  state  feedback  law  (8)  if  there  exist  matrices  Hj  € 
RTOXn,  and  Xtj  >  0,  i,j  =  1,2 such  that 


'  P{Ai  +  Bi(EsFj  +  E~Hj))  +  (*)T  +  PMiXijMfP  (*)T 
Nu  4-  N2l  (EsFj  +  E~  Hj )  X{j 


<0,  i,je[l,r],se[l,2m),  (33) 


and  tt(P,p)  C  f)Li 


Proof.  Choose  a  Lyapunov  function  V(x(t))  =  xT(t)Px(t).  We  note  that 


implies 


since  X)i=i  Pj  r  1  an(l  0  <  pj  <  1-  Let 


Then,  by  Lemma  1, 


V(x)  =  xT(t){ 


xef]  C(Hj), 

j=i 


e  c  ( E  pm  I  ’ 

J=1 


H  =  E^i- 

3= 1 


r  2m 


YPi  YPs  (A*  +  Ei(EsE  +  Es  E)) 


Li=l  s= 1 
r  2rn 


■»]) 


x(t) 


+p  E^E^(ii+^(^+^“#) 

1|i=l  5=1 

f2m  t  T 

E^E  E  pw  {Alijp + pA  s,i,j  )  ^  *(*), 


^  s- 1  i=i  j= i 

for  all  x  €  C(H).  It  is  easy  to  see  that  V(x)  <  0  if 

A^jP  +  PAs,i,j  <  0, 


(34) 


for  all  i,j  E  [1,  r],  and  s  €  [l,2mj.  Note  that 

As,ij  =  Ai  +  AAi  +  ( B{  +  A Bi)(EsFj  +  Es  Hj) 

=  Ai  +  Bi{EsFj  +  EjHj)  +  Mi©i{t)  (Nu  +  N2i(EsFj  4  E~ Hj))  , 
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and 


PM{Qi(t)  (Nu  +  N2i(EsFj  +  Es  Hj))  +  (*)T 
<  PMiXijMjP  +  (NU  +  Nu(E,Fj  +  EjH^f  Xrx  (Nu  4-  N2l(EsFj  +  E~ Hf))  . 

This  implies  that  if  the  matrix  inequalities  (33)  hold,  then  we  have 

AlitjP  +  PAs,ij  <  0,  *,  j  €  [1,  r],  a  e  [1, 2m], 

and  hence  V(x)  <  0  for  all  x  €  ft(P, p)\{0}.  That  is,  fi(P, p)  is  contractively  invariant.  ■ 

Corollary  6  For  the  special  case  of  B{  =  B  for  all  i.  the  ellipsoid  fi(P ,  p)  is  a  contractively  invariant 
set  of  the  closed-loop  system  under  the  fuzzy  scheduling  state  feedback  control  law  (8),  if  there  exist 
matrices  Hi  E  Mmxn  and  X{  >  0  such  that 

\P(Al  +  Bi(E,Fi  +  E7Hi))  +  M-'  +  PMiXlM?P  (.)*  1  ^  ;  e  n  r],  ,  e  (35) 

Nu+N-,i(E,Fi  +  E;Hi)  X,  J  ’ 

and  ft(P,p)  C  fl[=i  E{Hi). 


In  what  follows,  we  will  present  a  less  conservative  set  invariance  condition. 
Note  that  system  (32)  can  be  rewritten  as 


2m 


i{t)  =  E  ^2pUs,i,i + E  E  2pipj 

5=1  I  i=l  i=l  j<i 


>  x(t). 


Let 


Pi  ■■= 

As, i  := 


{ 

{ 


pi  i  = 

2 PiPj  l  =  i‘j 
As.i.i 


,  for  i  <  j  =  1,2,-  •  •  ,r, 
l  =  i 2 


( As,i,j  +  As,j,i)/ 2  l  —  i  •  j 


.  ,  for  i  <  j  =  1, 2,  ■ 


We  then  have 


and 


Hence, 


r(r+l)/2 

o  <  pi  <  i,  E  pi  =  i, 

i=i 

2m  r(r+l)/2 

i(t)  =  Y/Vs  E  piAs,ix(t). 
s= 1  1=1 


V{x)  =  xT(t) 


2m  r(r+l)/2 

E  E 


s=l  Z=1 


x(t). 


Theorem  7  Por  a  given  uncertain  fuzzy  system  (27),  suppose  that  the  local  state  feedback  control 
matrices  Fj,  j  =  l,2,---,r,  are  known.  The  ellipsoid  Q(P,p)  is  a  contractively  invariant  set  of  the 
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closed-loop  system  under  the  fuzzy  scheduling  control  law  (8),  if  there  exist  matrices  Hj  €  K  and 
Xij  >  0,  ij  =  1,2 ,  •  •  •  ,r,  such  that 


f  P{Ai  +  BiiEsFi  +  E~ Hi))  +  (*)T  +  PMiXuMfP  (*)T  1  .  -  r],  s  g  [1, 2"], 

[  Nxi  +  N2i(EsF  +  E-H)  Xu  J 


Nu  +  NxiEsF  +  E-H) 

P  ( Ai  +  Bi(EsFj  +  EjHj))  +  ( *)T 
+P  (Aj  +  Bj{EsFi  +  E~Hi))  +  ( *)T  (*)T  (*)T 

+PMiXijM?P  +  PMjXjiMj  P 
Nu  4-  N2i(EsFj  +  E~  Hj) 

Nu  +  NiJEsFi  +  E7Hi) 


(36) 


0 


<0,  i  <  j  £.  [1,  r],  s  G  [1, 2m],  (37) 


and  tt(P,p)  C  fli=i  £{Hi). 


Proof.  Choose  the  Lyapunov  function  as 


V(x)=xT{t)Px{t). 


Then, 


2m  r  r 


y(*)  =  w/W  [(^  +  +  *7*i))T p  +  p(^  +  ^ 

s— 1  £=1  j— 1 

It  is  easy  to  see  that  V (x)  <  0  if 

(Ai  +  Bi(EsFi  +  EjHitf  P  +  p[Ai  +  Bi(EsFi  +  E~  Hi))  <  0, 


-Hj))]  x(t). 


and 


P$s,i,j  +  $J,i,jP  <  °> 


(38) 

(39) 


where 

$s,i,j  =  Ai  +  Bi(EsFj  +  EjHj)  +  Aj  +  Bj(EsFi  +  E~  Hi). 

Similar  to  the  proof  of  Theorem  5,  we  can  find  that  matrix  inequality  (38)  holds  if  (36)  holds.  In  what 
follows,  we  will  prove  that  matrix  inequality  (39)  holds  if  (37)  holds.  Note  that 

=  Ai  +  Bi(EsFj  +  E~Hj)  +  MiQi(t)  (Nu  +  N2i(EsFj  +  EjHj)) 

+Aj  +  Bj(EsFi  +  EjHi)  +  MjQj(t)  (Nxj  +  N2j(EsFi  +  EJH)) , 


and 

PMi<di{t)  (Nu  +  N2i(EsFj  +  E~Hj))  +  MjQj{t)  (Nxj  +  N2j(EsFi  +  EJH))  +  (*)T 
<  PMiXijMfP  +  (Nu  +  N2i(EsFj  +  Es  Hj))  X^1  (Nu  +  N2i{EsFj  +  Es  Hj)) 
+PMjXjiMjP  +  (Nij  +  N2j(EsFi  +  EjHi)yXJ?  (Nxj  +  N2j(EsFx  +  E~ Hi))  . 

Then,  P®s,i,j  +  $£yp  <  0  if  (37)  holds-  * 

Remark  3  In  comparison  with  Theorem  5,  the  number  of  matrix  inequalities  in  Theorem  7  is  reduced 
by  r[r  —  1)  •  2m_1.  In  comparison  with  Corollary  6,  another  r(r  —  1)  •  2m  1  matrix  inequalities  can  be 
removed  for  the  special  case  of  Bi  =  -B,  Vi. 
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Let 


Q  =  ( P/pT1,  Yj  =  FjQ,  Zj  =  HjQ,  j  =  [l,r]. 

Denote  the  i-th  row  of  the  matrix  Zj  as  zj.  Then  (36)  and  (37)  are  equivalent  to  the  following  LMIs 


and 


{AiQ  +  Bi{EsYi  +  EjZi))  +  (*)T  +  MiXaMj  ( *)T 
NUQ  +  N2i{EjYi  +  EjZi)  Xu 

( AiQ  +  Bi(EsYj  +  E-Zj))  +  (*y 


<0,  i  e[l,r],5  6[l,2w],  (40) 


+  (AjQ  +  Bj(EsYi  +  EjZi))  +  (*)T 

(*)T 

(*)T 

+MlXijM(  +  MjXjiM j 

NuQ  +  N2i{EsYj  +  Ej  Zj) 

** 

0 

NijQ  +  N2j{EsYi  +  Ej  Zi) 

0 

Xji 

<0,  i  <  j  £  [l,r],  s  £  [l,2m],  (41) 


respectively.  Then,  we  have  the  following  theorem. 

Theorem  8  For  a  given  uncertain  fuzzy  system  (27),  the  fuzzy  scheduling  state  feedback  control  law 
(8)  such  that  the  closed-loop  system  is  robustly  stable  at  the  origin  with  a  domain  of  attraction  as  large 
as  possible  can  be  solved  by 

Fj  =  YjQ~\  j  =  [1  ,r], 

where  (Q  >  0,  Yj)  is  a  solution  to  the  following  LMI  optimization  problem 

(42) 


mm  7, 
Q>0,Yj,Zj 


s.t. 


a)  LMI  (18)  or  (19), 

b)  LMIs  (40)  and  (41), 

1  zP-  ' 

c )  ^jy  Q  >0,  Vi  e  [l,m],  j  e  [l,r]. 


5  An  Example 


Consider  the  problem  of  balancing  and  swing-up  of  an  inverted  pendulum  on  a  cart.  The  equations 
of  motion  for  the  pendulum  are  [22], 


Xl 

X2 


X2, 

gsin(rri)  —  amlx  2sin(2xi)/2  —  gacos{x\)v 
41/3  —  ami  cos2  (27) 


(43) 

(44) 


where  xi  denotes  the  angle  (in  radians)  of  the  pendulum  from  the  vertical,  x2  is  the  angular  velocity, 
g  =  9.8m/ s2  is  the  gravity  constant,  m  is  the  mass  of  the  pendulum,  M  is  the  mass  of  the  cart,  21  is 
the  length  of  the  pendulum,  v  is  the  force  applied  to  the  cart  (in  Kilo-Newtons),  a  =  l/(m  +  M)  and 
p.  =  1000.  We  choose  m  =  2.0 kg,  M  =  8.0 kg,  21  =  1.0m  in  the  simulations. 

The  control  objective  is  to  balance  the  inverted  pendulum  for  the  approximate  range  x\  €  [— tt/2, 
jt/2].  The  actuator  is  subject  to  saturation  and  the  saturation  level  is  um3x  =  1.  That  is,  we  would 
like  to  design  a  state  feedback  control  law 


v  =  cr(u(x)), 


(45) 
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such  that  the  inverted  pendulum  can  be  balanced  in  the  approximate  range  [  7r/2,  tt/2]. 

First  we  linearize  the  plant  (43)- (44)  at  the  origin  and  design  a  constant  linear  control  law  u  =  Fx 
based  on  the  linearizing  model.  It  is  easy  to  get  the  linearizing  model, 


0  1  ' 

0 

X  — 

3  n 

X  + 

—pa 

.  41/3  —  ami 

I 

1 

CO 

_ 1 

v . 


(46) 


By  placing  the  closed-loop  eigenvalues  at  {—2,  -2},  we  have  [22] 

F=[  0.1207  0.0227  ].  (47) 

First,  we  use  Theorem  3  and  optimization  problem  (21)  to  estimate  the  permissible  balancing  range  of 
xx  through  estimating  the  domain  of  attraction  of  the  closed-loop  system.  To  apply  the  optimization 

method  introduced  in  Section  2.2,  we  set  XR  =  j  |  J  ]  j .  Solving  optimization  problem  (21),  we 

obtain 

Umax  =  10.2026, 

which  corresponds  to  an  angle  much  larger  than  7r/2.  By  applying  the  above  controller  to  the  true 
plant  (43)-(44),  however,  we  find  that  when  xx  >  42°,  x2  =  0,  the  constant  controller  (47)  fails  to 
balance  the  pendulum.  This  is  because  of  the  very  large  modeling  error  between  linear  system  (46) 
and  original  nonlinear  system  (43)-(44). 

Now,  we  take  the  fuzzy-scheduling  control  design  approach  proposed  in  this  paper.  We  approximate 
the  system  by  the  following  two-rule  fuzzy  model 


Rule  1:  IF  x\  is  about  0 

THEN  x  =  Aix  +  B\v, 

Rule  2:  IF  x\  is  about  ±7r/2  (|si|  <  7r/2) 
THEN  x  =  A2x  +  B2v, 


(48) 


where 


0  1  ■ 

= 

3  Q 

41/3  —  ami 

0 

a2  = 

9 

1 - 

CO 

i 

to 

Bi  = 


1 

0 


0 

—pa 


41/3  —  ami  J 


“1 

0 

,B2  = 

—pa/3 

41/3  —  aml/32 

and  P  —  cos(86°).  Membership  functions  for  Rule  1  and  Rule  2  are  set  as  follows 

pi  =  cos(xi),  p2  -  1  -  pi, 

which  are  shown  in  Figure  1. 

The  following  fuzzy-scheduling  control  law  is  used  to  balance  the  plant 

Rule  1:  IF  x\  is  about  0 
THEN  u  =  Fix, 

Rule  2:  IF  xi  is  about  ±ir/2  (|mi  |  <  7t/2) 

THEN  u  =  F2x. 


(49) 
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Figure  1:  Membership  functions  of  two-rule  model. 


By  placing  the  eigenvalues  of  both  Ay  +  ByFy  and  .4 2  +  B2F2  {—2,  —2},  we  have 

Fi  =  [  0.1207  0.0227  ] ,  F2  =  [  0.8292  0.3820  ] .  (50) 

In  the  absence  of  saturation,  this  control  law  can  balance  the  pendulum  for  initial  conditions  xy  e 
[—88°,  88°]  (x2  =  0)  as  the  control  law  proposed  in  [22]. 

Then,  we  apply  our  optimization  method  to  estimate  the  balancing  range.  By  solving  optimization 
problem  (42),  we  obtain 

Umax  =  2.2357. 

which  still  corresponds  to  an  angle  larger  than  tt/2.  This  implies  that  control  law  (50)  should  be 
able  to  balance  the  pendulum  in  the  required  range  [ — vr/2,  vr/2]  even  in  the  presence  of  saturation. 
However,  simulation  indicates  that  the  fuzzy-scheduling  control  law  (8)  can  balance  the  pendulum 
for  initial  conditions  xy  £  [-84°,84°]  (x2  =  0)  in  the  presence  of  saturation.  Figure  2  shows  the 
response  of  the  pendulum  system  using  linear  and  fuzzy  scheduling  controls  for  initial  conditions 
xi  =  20°, 40°, 45°, 84°,  and  x2  =  0.  The  solid  curves  indicate  responses  with  the  fuzzy  scheduling 
controller.  The  dashed  curves  show  those  with  the  linear  constant  controller. 

^From  the  curves,  we  can  also  find  that  the  fuzzy  scheduling  controller  can  lead  to  fast  responses. 
We  can  also  use  Theorem  7  and  optimization  problem  (42)  to  design  a  controller  such  that  the 
balancing  range  is  as  large  as  possible.  Solving  optimization  problem  (42),  we  obtain  the  following 
result 

ttmax  =  2.2361, 

Fy  =  [  5.2016  2.4764  ]  ,  F2  =  [  6.2736  2.9962  ] .  (51) 

Note  that  amax  =  2.2361  corresponds  to  an  angle  of  128°.  By  applying  the  above  controller  to  the 
true  plant  (43)- (44)  with  initial  conditions  xx  =  84°,  45°  and  20°  (x2  =  0),  the  system  responses  are 
shown  in  Figure  3. 
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Figure  2:  Angle  response  using  linear  and  two-rule  fuzzy  control:  dashed  curves  -  linear  control;  solid 
curves  -  fuzzy  control. 


Because  the  modeling  error  is  not  considered,  the  stability  region  of  the  fuzzy  system  may  not  be 
that  of  the  original  nonlinear  system.  In  what  follows,  we  will  analyze  the  modeling  error  between 
above  fuzzy  model  and  the  actual  pendulum  model  (43)-(44). 

With  the  fuzzy  rules  shown  in  (48),  the  resulting  fuzzy  system  is  given  by 


X\  =  X2 , 

(  q  2  g  \  (  ,  -fia/3  \  (  * 

X2  =  \4l/3  —  amlPl  +  7r(4i/3  -  omZ/?2)P2J  11  +  \4Z/3  -  amlPl  +  41/3  -  aml0zP2)  V‘ 

The  difference  between  (44)  and  (52)  is 

A/  =  fXlx  1  +  fx  2^2  +  fvV, 


where 


fx  1 
fx  2 
fv 


jgjgfo) _ (  9  P1  + _ ?£ _ 

(41/3  —  ami  cos2 (x\))xi  \  41/3  — ami  -k(41/3  —  aml/32)  J 

—amlx  2  sin(2xi)/2 
41/3  —  ami  cos2(®i)  ’ 

fia  naf3  /j,a  cos(xx) 

41/3  -  amlPi  +  41/3  -  aml^P 2  41/3  -  ami cos2(a;i) ' 


Now  we  use  the  following  uncertain  fuzzy  model  to  analyze 


the  stability  of  the  original  system 


Rule  1:  IF  x\  is  about  0 

THEN  x  =  (A1  +  AAx)x  +  (Bx  +  A Bx)v,  ^ 

Rule  2:  IF  xx  is  about  ±7r/2  (|xi|  <  7t/2)  1 

THEN  x  =  (A2  +  A A2)x  +  (B2  +  A B2)v. 

In  the  above  uncertain  fuzzy  models,  we  assume  that  the  uncertainties  that  describe  the  modeling 
errors  are  in  the  form  of 


AAi  =  Mi©(t)Nn,  AB\  =  MiQ(t)Ni2, 
AA2  =  M2Q(t)N21,  AB2  =  M2@(t)N22, 
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time  t 


Figure  3:  State  and  input  with  different  initial  conditions:  solid  curves  -  84°;  dotted-dashed  curves  - 
45°;  dashed  curves  -  20°. 


where  ©(<)  =  diag(#i(t),02(t),  @3(t))  with  ||0t(t)||  <  1,  and 

-|T 


Mi  = 


M2  = 


0  0  0 
1  1  1 

0  0  0 
1  1  1 


,  Nn  = 


iT 


,  Nix  = 


an  0 
0  ai2 
0  0 

021  0 
0  a22 

0  0 


,  JVi2  = 


,  n22  = 


0 

0 

h 

0 

0 

62 


The  parameters  an,  012,021,^22,  h  and  b2  are  to  be  determined.  Hence,  the  uncertain  nonlinear  fuzzy 
system  is 

x  =  \p\{A\  +  AAi)  +^2(^2  +  AA2)]x  (54) 

+\p\{B\  +  AjBi)  +  p2(B2  +  A  B2)]v 


+(PiOn  +  p2a2\)0\{t)x\  +  (piai2  +  p2a22)62{t)x2  +  (pibi  +  p2b2)0s(t)v. 
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If  we  set  a\i  =  a^\  =  gi,  ayz  —  0*22  =  a2  and  b\  =  62  =  6,  then  they  can  be  chosen  as 

01  =  max  H/xJI,  a2  =  max  ||/*2||,  b=  max  ||/„||. 
*j€t -7r/2,7r/2]  H  1,1  xi€[— *ie[-ir/2,ir/2] 

If  we  constrain  ||m2||  <  10,  then  we  gain 

oi  =  4.6757,  o2  =  0.813,  b  =  8.9697. 


With  the  fixed  controller  (47),  the  optimization  problem  (31)  has  no  solution.  When  the  controller  is 
not  fixed,  we  obtain  following  result 

cw  =  1.2111  (=  69°), 

F  =  [  0.8998  0.4021  ]  . 

Simulation  results  with  this  controller  are  shown  in  Figure  4.  This  simulation  shows  that,  by  optimizing 
the  feedback  gain  as  in  Section  4,  even  a  constant  controller  is  able  to  balance  the  pendulum  in  range 
of  [-84°,  84°]. 


time  t 


Figure  4:  State  and  input  responses  with  different  initial  conditions:  solid  curves  -  84°;  dotted-dashed 
curves  -  69°;  dashed  curves  -  45°. 


20 


6  Conclusions 

In  this  paper,  the  TS  fuzzy  modeling  approach  was  extended  to  represent  nonlinear  systems  subject 
to  actuator  saturation.  Based  on  this  fuzzy  representation,  we  developed  stability  analysis  and  design 
methods  for  nonlinear  systems  subject  to  actuator  saturation.  By  their  application  to  an  inverted 
pendulum,  our  methods  are  shown  to  be  very  effective. 
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